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I: Introduction 

1.1. CR extension theory. In the past decades, remarkable progress has 
been accomplished towards the understanding of compulsory extendability 
of holomorphic functions, of CR functions and of differential forms. These 
phenomena, whose exploration is still active in current research, originate 
from the seminal Hartogs-Bochner extension theorem. 

In local CR extension theory, the most satisfactory achievement was the 
discovery that, on a smooth embedded generic submanifold M C C", there 
is a precise correspondence between CR orbits of M and families of small 
Bishop discs attached to M. Such discs cover a substantial part of the poly- 
nomial hull of M, and in most cases, this part may be shown to constitute 
a global one-sided neighborhood V^(Af) of M, if M is a hypersurface, or 
else a wedgelike domain W attached to M, if M has codimension ^ 2. 
A local polynomial approximation theorem, or a CR version of the Konti- 
nuitatssatz (continuity principle) assures that CR functions automatically 
extend holomorphically to such domains W, which are in addition con- 
tained in the envelope of holomorphy of arbitrarily thin neighborhoods of 
M in C". 

Trepreau in the hypersurface (1986) case and slightly after Tumanov in 
arbitrary codimension (1988) established a nowadays celebrated extension 
theorem: if M C C" is a sufficiently smooth (C^ or C^'° suffices) generic 
submanifold, then at every point p G M whose local CR orbit Oq'^{M,p) 
has maximal dimension equal to dim M, there exists a local wedge Wp of 
edge M at p to which continuous CR functions extend holomorphically. 
Several reconstructions and applications of this groundbreaking result, to- 
gether with surveys about the local Bishop equation have already appeared 
in the literature. 

Propagational aspects of CR extension theory are less known by con- 
temporary experts of several complex variables, but they lie deeper in the 
theory. Using FBI transform and concepts of microlocal analysis, Trepreau 
showed in 1990 that holomorphic extension to a wedge propagates along 
curves whose velocity vector is complex-tangential to M. His conjecture 
that extension to a wedge should hold at every point of a generic subman- 
ifold M C C" consisting of a single global CR orbit has been answered 
independently by Joricke and by the first author in 1994, using tools intro- 
duced previously by Tumanov. To the knowledge of the two authors, there 
is no survey of these global aspects in the literature. 

The first main objective of the present survey is to expose the techniques 
underlying these results in a comprehensive and unified way, emphasizing 
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propagational aspects of embedded CR geometry and discussing optimal 
smoothness assumptions. Thus, topics that are necessary to build the the- 
ory from scratch will be selected and accompanied with thorough proofs, 
whereas other results that are nevertheless central in CR geometry will be 
presented in concise survey style, without any proof. 

The theory of CR extension by means of analytic discs combines var- 
ious concepts emanating mainly from three (wide) mathematical areas: 
Harmonic analysis. Partial differential equations and Complex analysis in 
several variables. As the project evolved, we felt the necessity of being 
conceptional, extensive and systematic in the restitution of (semi)known 
results, so that various contributions to the subject would recover a cer- 
tain coherence and a certain unity. With the objective of adressing to a 
younger audience, we decided to adopt a style accessible to doctoral can- 
didates working on a dissertation. Parts III, IV and V present elementarily 
general CR extension theory. Also, most sections of the text may be read 
independently by experts, as quanta of mathematical information. 

1.2. Concise presentation of the contents. The survey text is organized in 
six main parts. Actually, the present brief introduction constitutes the first 
and shortest one. Although the reader will find a "conceptional summary- 
introduction" at the beginning of each part, a few descriptive words ex- 
plaining some of our options governing the reconstruction of CR extension 
theory (Parts III, IV and V) are welcome. 

The next Part II is independent of the others and can be skipped in a 
first reading. It opens the text, because it is concerned with propagational 
aspects of analytic CR structures, better understood than the smooth ones. 

• In Part in, exclusively concerned with the smooth category, Sussmann's 
orbit theorem and its consequences are first explained in length. Involu- 
tive structures and embedded CR manifolds, together with their elementary 
properties, are introduced. Structural properties of finite type structures, of 
CR orbits and of CR functions are presented without proofs. As a collec- 
tion of background material, this part should be consulted first. 

• In Part IV, fundamental results about singular integral operators in the 
complex plane are first surveyed. Explicit estimates of the norms of 
the Cauchy, of the Schwarz and of the Hilbert transforms in the Holder 
spaces C^'" are provided. They are useful to reconstruct the main Theo- 
rem 3.7(IV), due to Tumanov, which asserts the existence of unique so- 
lutions to a parametrized Bishop-type equation with an optimal loss of 
smoothness with respect to parameters. Following Bishop's constructive 
philosophy, the smallness of the constants insuring existence is precised 
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explicitly, thanks to sharp norm inequalities in Holder spaces. This part 
is meant to introduce interested readers to further reading of Tumanov's 
recent works about extremal (pseudoholomorphic) discs in higher codi- 
mension. 

• In Part V, CR extension theory is first discussed in the hypersurface case. 
A simplified proof of wedge extendability that treats both locally minimal 
and globally minimal generic submanifolds on the same footing constitutes 
the main Theorem 4.12(V): If M is a globally minimal C^'" (0 < a < 
1 ) generic submanifold of C" of codimension ^ 1 and of CR dimension 
^ 1, there exists a wedgelike domain W attached to M such that every 
continuous CR function f G C^^(M) possesses a holomorphic extension 
F e nC°(MU W) with F\m = /• The figures are intended to share 

the geometric insight of experts in higher codimensional geometry. 

In fact, throughout the text, diagrams (33 in sum) facilitating readabil- 
ity (especially of Part V) are included. Selected open questions and open 
problems (16 in sum) are formulated. They are systematically inserted in 
the right place of the architecture. The sign "[*]" added after one or sev- 
eral bibliographical references in a statement (Problem, Definition, Theo- 
rem, Proposition, Lemma, Corollary, Example, Open question and Open 
problem, e.g. Theorem 1.11(1)) indicates that, compared to the existing 
literature, a slight modification or a slight improvement has been brought 
by the two authors. Statements containing no bibliographical reference are 
original and appear here for the first time. 

We apologize for having not treated some central topics of CR geometry 
that also involve propagation of holomorphicity, exempli gratia the geo- 
metric reflection principle, in the sense of Pinchuk, Webster, Diederich, 
Fornaess, Shafikov and Verma. By lack of space, embeddability of abstract 
CR structures, polynomial hulls. Bishop discs growing at elliptic complex 
tangencies, filling by Levi-flat surfaces, Riemann-Hilbert boundary value 
problems, complex Plateau problem in Kahler manifolds, partial indices 
of analytic discs, pseudoholomorphic discs, etc. are not reviewed either. 
Certainly, better experts will fill this gap in the near future. 

To conclude this introductory presentation, we believe that, although un- 
easy to build, surveys and syntheses play a decisive role in the evolution of 
mathematical subjects. For instance, in the last decades, the remarkable de- 
velopment of d techniques and of estimates has been regularly accom- 
panied by monographs and panoramas, some of which became landmarks 
in the field. Certainly, the (local) method of analytic discs deserves to be 
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known by a wider audience; in fact, its main contributors have brought it 
to the degree of achievement that opened the way to the present survey. 

1.3. Further readings. Using the tools exposed and reconstructed in this 
survey, the research article llMP2006all studies removable singularities on 
CR manifolds of CR dimension equal to 1 and solves a delicate remain- 
ing open problem in the field {see the Introduction there for motivations). 
Recently also, the authors built in ||MP2006cll a new, rigorous proof of the 
classical Hartogs extension theorem which relies only on the basic local 
Levi argument along analytic discs, hence avoids both multidimensional 
integral representation formulas and the Serre-Ehrenpreis argument about 
vanishing of d cohomology with compact support. 
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II: Analytic vector field systems 
and formal CR mappings 
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[3 diagrams] 



According to the theorem of Frobenius, a system L of local vector fields hav- 
ing real or complex analytic coefficients enjoys the integral manifolds property, 
provided it is closed under Lie bracket. If the Lie brackets exceed L, considering 
the smallest analytic system L'"^ containing L which is closed under Lie bracket, 
Nagano showed that through every point, there passes a submanifold whose tan- 
gent space is spanned by L^"^. Without considering Lie brackets, these submani- 
folds may also be constructed by means of compositions of local flows of elements 
of L. Such a construction has applications in real analytic Cauchy-Riemann ge- 
ometry, in the reflection principle, in formal CR mappings, in analytic hypoellip- 
ticity theorems and in the problem of local solvability and of local uniqueness for 
systems of first order linear partial differential operators (Part III). 

For a generic set of r ^ 2 vector fields having analytic coefficients, L''° has 
maximal rank equal to the dimension of the ambient space. 

The extrinsic complexification of a real algebraic or analytic Cauchy- 
Riemann submanifold M of C" carries two pairs of intrinsic foliations, obtained 
by complexifying the classical Segre varieties together with their conjugates. The 
Nagano leaves of this pair of foliations coincide with the extrinsic complexifica- 
tions of local CR orbits. If M is (Nash) algebraic, its CR orbits are algebraic too, 
because they are projections of complexified algebraic Nagano leaves. 

A complexified formal CR mapping between two complexified generic sub- 
manifolds must respect the two pairs of intrinsic foliations that lie in the source 
and in the target. This constraint imposes strong rigidity properties, as for in- 
stance: convergence, analyticity or algebraicity of the formal CR mapping, ac- 
cording to the smoothness of the target and of the source. There is a combina- 
torics of various nondegeneracy conditions that entail versions of the so-called 
analytic reflection principle. The concept of CR reflection mapping provides a 
unified synthesis of recent results of the literature. 
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§1. Analytic vector field systems and Nagano's theorem 

1.1. Formal, analytic and (Nash) algebraic power series. Let n e N 

with n ^ 1 and let x = (xi, . . . , x„) G K", where K = M or C. Let K|x] 
be the ring of formal power series in (xi, . . . , x„). An element (/?(x) G K|x] 
writes ip{x) = XlaeN" x", with x" := x"^ ■ ■ ■ x°" and with if^ G K, for 
every multiindex a := (ai, . . . , a„) G N". We put \a\ := ai + ■ • ■ + an- 

On the vector space K", we choose once for all the maximum norm 
|x| := maxi^j^n |x.j| and, for any "radius" pi satisfying < pi ^ oo, we 
define the open cube 

■= {x G K" : |x| < Pi} 

as a fundamental, concrete open set. For pi = oo, we identify of course 
with K". 

If the coefficients ifa satisfy a Cauchy estimate of the form \Lpa\ ^ 
CP2'"', C > 0, for every p2 satisfying < p2 < pi, the formal 
power series is K-analytic (C^) in D^'^. It then defines a true point map 
(f : — ^ K. Such a K-analytic function is called (Nash) K-algebraic 
if there exists a nonzero polynomial P(X, $) G K[X, $] in (n+ 1) variables 
such that the relation P(x, (p(x)) = holds in K[x], hence for all x in D^^. 
The category of K-algebraic functions and maps is stable under elementary 
algebraic operations, under differentiation and under composition. Implicit 
solutions of K-algebraic equations are K-algebraic ([BER1999J). 

1.2. Analytic vector field systems and their integral manifolds. Let 

be a finite set of vector fields La = ^"=1 '^a,ii'^) ^> whose coefficients 
ipa,i are algebraic or analytic in . Let A^^ denote the ring of algebraic 
or analytic functions in . The set of linear combinations of elements of 
L° with coefficients in A^^ will be denoted by L (or L^) and will be called 
the Kp^-limar hull of L°. 

If p is a point of D^J^, denote by La{p) the vector YJLi ^a,i{p) It 
is an element of TpD^^ ^ K". Define the linear subspace 

Up) := Spang {L,(p) : 1 ^ a ^ r} = {L{p) : L G L}. 

No constancy of dimension, no linear independency assumption are made. 

Problem 1.3. Find local submanifolds A passing through the origin satis- 
fying TqA D L(g) for every g G A. 
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By the theorem of Frobenius ( IIStk2000ll : original article: llFrl877H ). if the 
La are linearly independent at every point of and if the Lie brackets 
[La, La'] belong to L, for all a, a' = 1, . . . , r, then Dj^^ is foliated by r- 
dimensional submanifolds satisfying TgN = L(g) for every q E N. 

Lemma 1.4. If there exists a local submanifold A passing through the ori- 
gin and satisfying TgA D L(g) for every g G A, then for every two vector 
fields L,L' Eh, the restriction to A of the Lie bracket [L, L'] is tangent to 
A. 

Accordingly, set := L and for ^ 2, define L''' to be the A^^- 
linear hull of L'^^^ + L^^^] . Concretely, L*^ is generated by A^^ -linear 
combinations of iterated Lie brackets [Li, [L2, . . . , [Lk-i, Lk] •••]], where 
Li, L2, . . . , Lk-i, Lk G The Jacobi identity insures (by induction) that 
[L*^i,L^2] ^ L^i+fc2_ Define then L"<= := Ufc^iL^ Clearly, [L, L'] G L"^ 
for every two vector fields L, L' G L'"'. 

Theorem 1.5. (Nagano IINal966[ ITrvl992l IBER19991 IBCH2005II ) 

There exists a unique local K-analytic submanifold A of passing 
through the origin which satisfies L(g) C TgA = l}^'^[q), for every g G A. 

A discussion about what happens in the algebraic category is postponed 
to §1.12. In Frobenius' theorem, L^"^ = L and the dimension of l}^^{p) 
is constant. In the above theorem, the dimension of L^"^(g) is constant for 
q belonging to A, but in general, not constant for p G D^^ , the function 
p ^ dimic h{p) being lower semi-continuous. 

Nagano's theorem is stated at the origin; it also holds at every point 
p G D^^. The associated local submanifold Ap passing through p with the 
property that T^A = L''°(g) for every g G Ap is called a (local) Nagano 
leaf. 

In the category, the consideration of L''® is insufficient. Part III 
handles smooth vector field systems, providing a different answer to the 
search of similar submanifolds Ap. 

Example 1.6. In M?, take L° = {Li,L2}, where Li = dy^^ and L2 = 
e"i/'^i • Then is the line M«9xJo, while V'%p) = Rd^, |p + Rd^^ \p 

at every point p ^Rx {0}. Hence, there cannot exist a C°° curve A passing 
through with TqA = Rdy,^ |o and TgA = V'%q) for every g G A. 

Proof of Theorem L5. (May be skipped in a first reading.) If n = 1, 
the statement is clear, depending on whether or not all vector fields in L''° 
vanish at the origin. Let n ^ 2. Since L(g) C L^^'^(g), the condition 
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TqK = V'%q) implies the inclusion L(g) C T^A. Replacing L by L^'" if 
necessary, we may therefore assume that L^'" = L and we then have to 
prove the existence of A with T^A = L'"^(g) = L(g), for every g G A. 

We reason by induction, supposing that, in dimension {n — 1), for every 
Ap^ -linear system L' = (L')'"^ of vector fields locally defined in a neighbor- 
hood of the origin in K"^^, there exists a local K-analytic submanifold A' 
passing through the origin and satisfying Tg/A' = L'(g'), for every q' E A'. 

If all vector fields in L = L^"^ vanish at 0, we are done, trivially. Thus, 
assume there exists Li G L with Li(0) ^ 0. After local straightening, 
Li = . Every L G L writes uniquely L = a{x) d^-^ + L, for some 
a(x) G K{x}, with L = J22<i<n '^«(^) ^x,- Introduce the space L := {L : 
L G L} of such vector fields. As belongs to L and as L is Ap^ -linear, 
L = L — a(x) (9x1 belongs to L. Since [L, L] C L, we have [L, L] C L. 
On the other hand, we observe that the Lie bracket between two elements 
of L does not involve 9xi : 

= E ( E [<^^-<^]h^- 

We deduce that [L, L] C L. In other words, L''*^ = L. Next, we define the 
restriction 

L':={L' = ZL ^ -ZgL}, 

L l{xi=0} J ' 

and we claim that (L')''° = L' also holds true. Indeed, restricting (1.7) 
above to {xi = 0}, we observe that 

since neither Li nor L2 involves c^x^. This shows that [L',L'] C L', as 
claimed. 

Since (L')^"^ = L', the induction assumption applies: there exists a local 
K-analytic submanifold A' of K"~^ passing through the origin such that 
TyiA' = L'(g'), for every point q' G A'. Let d denote its codimension. 
If d = 0, i.e. if A' coincides with an open neighborhood of the origin in 
K"^^, it suffices to chose for A an open neighborhood of the origin in K". 
Assuming d ^ 1, we split the coordinates x = (xi, x') G K x K"^"^ and we 
let Pj (x') = 0, j = 1, . . . , d, denote local K-analytic defining equations for 
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A'. We claim that it suffices to choose for A the local submanifold of IfC^ 
with the same equations, hence having the same codimension. 

Indeed, since these equations are independent of xi, it is first of all clear 
that the vector field d^^ G L is tangent to A. To conclude that every L = 
a + L G L is tangent to A, we thus have to prove that every L G L is 
tangent to A. 

Let L = Yj2<iit^n '^*(^' G L. As a preliminary observation: 

(adSxjZ := [Sx,,!] = Ir^^'i''''^^' 



dxi dxi 



and more generally, for ^ G N arbitrary: 



Since L is a Lie algebra, we have (ad^xj^l/ G L. Since (ad^xj^l/ does 
not involve (9xi, according to its expression above, it belongs in fact to L. 
Also, after restriction (ad 9xJ^L|^^_q G L'. By assumption, L' is tangent 
to A'. We deduce that, for every £ G N, the vector field 

is tangent to A'. Equivalently, [L^pj](x') = for every x' G A'. Letting 
(xi, x') G A, whence x' G A', we compute: 



[Lp,](xi,x')= Yl a.(xi,x')^(x' 



E E 9" >^') ^(>^') [Taylor development] 



oo 



so L is tangent to A. Finally, the property Tx^^x'A = L(xi,x') follows 
immediately from Tx/A' = L'(x') and the proof is complete (the Taylor 
development argument above was crucially used, and this enlightens why 
the theorem does not hold in the category). 
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1.8. Free Lie algebras and generic sets of K-analytic vector fields. For 

a generic set of r ^ 2 vector fields L° = {iva}i<ja^,., or after slightly per- 
turbing any given set, one expects that L^"^(0) = TqK". Then the Nagano 
leaf A passing through is just an open neighborhood of in K" . Also, one 
expects that the dimensions of the intermediate spaces L'' (0) be maximal. 

To realize this intuition, one has to count the maximal number of iter- 
ated Lie brackets that are linearly independent in L'^, for A; = 1, 2, 3, ... , 
modulo antisymmetry and Jacobi identity. 

Let r ^ 2 and let hi, h2, ■ ■ ■ , K be r linearly independent elements 
of a vector space over K. The free Lie algebra F(r) of rank r is the 
smallest (non-commutative, non-associative) K-algebra ( [|Rel993ll ) hav- 
ing hi, h2, ■ ■ ■ , hr as elements, with multiplication {h, h') ^ hh' satis- 
fying antisymmetry = hh' + h' h and Jacobi identity = h{h' h") + 
h"{hh') + h'{h" h). It is unique up to isomorphism. The case r = 1 
yields only F(l) = K. The multiplication in F(r) plays the role of the 
Lie bracket in L^"^. Importantly, no linear relation exists between iterated 
multiplications, i.e. between iterated Lie brackets, except those generated 
by antisymmetry and Jacobi identity. Thus, F(r) is infinite-dimensional. 
Every finite-dimensional Lie K-algebra having r generators embeds as a 
subalgebra of F(r), see [|Rel993l . 

Since the bracket multiplication is not associative, one must carefully 
write some parentheses, for instance in {hih2)h^, or in /ii(/i2(/ii ^2)), 
or in [hi h2){h^{h^hi)). Writing all such words only with the alphabet 
{hi,h2, . . . ,hr},^e define the length of a word h to be the number of ele- 
ments hi^ in it. For £ e N with £ ^ 1, let be the set of words of length 
equal to £ and let = |J^>i '^he set of all words. 

Define Fi(r) to be the vector space generated hy hi, h2, . . . , K and for 
i ^ 2, define F^(r) to be the vector space generated by words of length 
^ i. This corresponds to L^, except that in L^, there might exist special 
linear relations that are absent in the abstract case. Thus, F(r) is a graded 
Lie algebra. The Jacobi identity insures (by induction) that F^^ i'i")Fi^ (r) C 
Fi^+e^ir), a property similar to [L^SL''^] c L^i+*^2_ ^ follows that Fi{r) 
is generated by words of the form 

hi,{hi^{. . . {hi^,^hi^,) ...)), 

where i' ^ i and where 1 ^ ii,i2, . . . ,i£'-i,i£' ^ r. For instance, 
{hi h2){h^{h^ hi)) may be written as a linear combination of such simple 
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words whose length is ^ 5. Let us denote by 

the set of these simple words, where SW^ denotes the set of simple 
words of length i. Although it generates F(r) as a vector space over 
K, we point out that it is not a basis of F(r): for instance, we have 
hi{h2{h]h2)) = h2{hi{hih2)), because of an obvious Jacobi identity in 
which {hih2){hih2) = disappears. In fact, one verifies that this is the 
only Jacobi relation between simple words of length 4, that simple words 
of length 5 have no Jacobi relation, hence a basis of F5(2) is 

hi, h2, hih2, 

hi{hih2), h2{hih2), 

hi{hi{hih2)), hi{h2{hih2)), h2{h2{h2hi)) , 

h{h{h{hh2))), h{h{h2{hh2))), h{h2{h2{h2h))), 

h2{h{h{hh2))), h2{h2{h{h2h))), h2{h2{h2{h2h))). 

In general, what are the dimensions of the fi{r)l How to find bases for 
them, when considered as vector spaces ? 

Definition 1.9. A Hall-Witt basis of F(r) is a linearly ordered (infinite) 
subset HWr = IJ^>i HWf. of the set of simple words SW^ such that: 

• if two simple words h and h' satisfy length (h) < length (h'), then 
h < h'; 

. H\Nl = {huh2,...,K}; 

• HW,' = {h,,hi, : 1 ^ 21 < 22 ^ r}; 

• HW,\(HW^ U HW^) = {h(h'h") : h,h',h" G HW„ h' < 
h" and h' ^ h < h'h"}. 

A Hall- Witt basis essentially consists of the choice, for every i ^ 1, of 
some (among many possible) finite subset HW^ of SW^ that generates the 
finite-dimensional quotient vector space F^(r)/F£_i(r). To fix ideas, an 
arbitrary linear ordering is added among the elements of the chosen basis 
HW^ of the vector space F^(r)/F£_i(r). The last condition of the definition 
takes account of the Jacobi identity. 

Theorem 1.10. ( l|Bol972[[Rel993ll ) Hall-Witt bases exist and are bases of 
the free Lie algebra F(r) of rank r, when considered as a vector space. The 
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dimensions r\e,{r) — n^_i(r) o/F£(r)/F£_i(r), or equivalently the cardinals 
of H W^, satisfy the induction relation 

n^(r) - n^_i(r) = j ^ ii{d) 

d divides I 

where i^i is the Mobius function. 

Remind that 

1, if = 1; 

^(rf) = 0, if (i contains square integer factors; 

— l)*^, if d = pi ■ ■ ■ Pj, is the product of u distinct prime numbers. 

Now, we come back to the system L° = {ivaji^a^r of local K-analytic 
vector fields of §1.1, where La = J2^=i V^a,j(x) If the vector space 
L(0) has dimension < r, a slight perturbation of the coefficients (Pa,i(x) of 
the La yields a system L' with L'(0) of dimension = r. By an elementary 
computation with Lie brackets, one sees that a further slight perturbation 
yields a system L"° with L"(0) of dimension r + ^-^^y^ = n2(r). 

To pursue, any simple iterated Lie bracket [L^^ , [La^ , • • • [Lai_i , La^] . . .]] 
of length £ is a vector field J^Li ^li,a2,...,a,_i,a, ^ having coefficients 
^ai,a2,...,ai_i,ai, ^^at are universal polynomials in the jets 

jrv(x) := (9>.,.(x)):j:;;':2'-: e k"™— 

of order (£ — 1) of the coefficients of Li, L2, . . . , L^. Here, Nrn,n,e-i = 
rn ^^^fzly denotes the number of such independent partial derivatives. A 

careful inspection of the polynomials ^ai,a2,...,af„i,a< enables to get the fol- 
lowing genericity statement, whose proof will appear elsewhere. It says in 
a precise way that L'"^(0) = TqK" with the maximal freedom, for generic 
sets of vector fields. 

Theorem 1.11. dlGVlQSVilGeTMl . [*]) Ifio denotes the smallest length 
i such that ni{r) ^ n, there exists a proper K-algebraic subset S of the jet 
space Jq^'^^p = K^'^""'^o-i such that for every collection IJ^ = {Laji^asCr 
of r vector fields La = Yl^=i Va,j(x) ^ such that Jo"~^v^(0) does not 
belong to S, the following two properties hold: 



dimL^(O) = n^(r),/or every £ ^ — 1, 
dimL^o(O) = n, hence = TqK". 
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The number of divisors of i being an O(j^), one verifies that n^^r) — 
r\£_i{r) = jT^ + 0(r^/^ i^)- follows that, for r fixed, the integer of 
the theorem is equivalent to as n ^ oo. 

~ log r 

1.12. Local orbits of K-analytic and of (Nash) K-algebraic systems. We 

now describe a second, more concrete, simple and useful approach to the 
local Nagano Theorem 1 .5. It is inspired by Sussmann's Theorem 1 .21(111) 
and does not involve the consideration of any Lie bracket. Theorem 1.13 
below will be applied in §2. 1 1 . 
As above, consider di finite set 

L° := {L4i^,^,, reN, r ^ 1, 

of nonzero vector fields defined in the cube and having K-analytic 
coefficients. We shall neither consider its Ap^ -linear hull L, nor L^^*^. We 
will reconstruct the Nagano leaf passing through the origin only by means 
of the flows of Li, L2, . . . , L,.. 

Referring the reader to § 1 .3(111) for background, we denote the flow map 
of a vector field L G L° shortly by (t, x) ^ Lt{x) = exp(tL)(x). It is K- 
analytic. What happens in the algebraic category ? 

So, assume that the coefficients of all vector fields L G L° are K- 
algebraic. Unfortunately, algebraicity fails to be preserved under integra- 
tion, so the flows are only K-analytic, in general. To get algebraicity of 
Nagano leaves, there is nothing else than supposing that the flows are al- 
gebraic, which we will do (second phrase of (5) below). 

Choose now p2 with < p2 < Pi- Let k E N with k ^ 1, let L = 
{L\...,L^)e (L0)^ let t = (ti, . . . , tfc) G with |t| < ps, i.e. t G Dj,, 
and let x G • We shall adopt the contracted notation 

L,(x):=4\(---(4\(x))..-) 

for the composition of flow maps, whenever it is defined. In fact, since 
Lo(0) = exp(OL)(0) = 0, it is clear that if we bound the length k ^ 2n, 
then there exists p2 > sufficiently small such that all maps (t, x) 1— ivt(x) 
are well-defined, with Lt(x) G D^^, at least for all t G D^^ and all x G D^^- 
The reason why we may restrict to consider only compositions of length 
k ^ 2n will appear a posteriori in the proof of the theorem below. We 
shall be concerned with rank properties of (t, x) 1— Lt(x). 

Let n ^ 1, m ^ 1, pi > 0, di > and let / : D^J^ ^ D™, x ^ /(x), 
be a K-algebraic or K-analytic map between two open cubes. Denote its 
Jacobian matrix by Jac (/) = (§^(x))|<^<^- At a point x G D^^, the map 
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/ has rank r if and only if Jac / has rank r at x. Equivalently, by linear 
algebra, there is a r x r minor that does not vanish at x but all s x s minors 
with r + 1 ^ s ^ n do vanish at x. 

For every s G N with 1 ^ s ^ min (n,m), compute all the possible 
sxs minors A^^*, . . . , A^^^^ of Jac (/). They are universal (homogeneous 
of degree s) polynomials in the partial derivatives of /, hence are all K- 
algebraic or K-analytic functions. Let e with ^ e ^ min(n, m) be 
the maximal integer s with the property that there exists a minor Ajj^'*(x), 
1 ^ ;U ^ N{s), not vanishing identically. Then the set 

Uf := {x G n;_^ : A-^(x) = 0, /i = 1, . . . , iV(.)} 

is a proper K-algebraic or analytic subset of U^^ . The principle of analytic 
continuation insures that U^\(Tlf is open and dense. 

The integer e is called the generic rank of /. For every open, connected 
and nonempty subset Vl C the restriction /|n has the same generic 
rank e. 

Theorem 1.13. ( IIMelQgQi lMe2001a[ lMe2004all ) There exists an integer 
e with 1 ^ e ^ n and an e-tuple of vector fields L* = {L*^, . . . , L**^) G 
(L^)"^ such that the following six properties hold true. 

(1) For every k = 1, . . . , e, the map (ti, . . . , t^) ^ 
L^^(- ■ ■ (L^^^(O)) ■ ■ ■) is of generic rank equal to k. 

(2) For every arbitrary element L' G L°, the map (ti, . . . , tg, t') t-^ 
L[,{Ll^{- ■ ■ (L*^^(0)) ■ ■ ■ )) of generic rank e, hence e is the max- 
imal possible generic rank. 

(3) There exists an element t* G arbitrarily close to the origin 
which is of the special form (t^, . . . , t*_^, 0), namely with t* = 0, 
and there exists an open connected neighborhood u* oft^ in 
such that the map t L^^i' ' ' (-^ti^(O)) ■ ■ ■) is of constant rank e 
in uo*. 

(4) Setting L* := {L*\ . . . , L*^), K* := (L^^'S . . . , L*^) and s* : = 
(-t*_i, . . . , -tl), wehave K*,oLl,{0) = and the map ip : u* 
□^^ defined by ip : t ^-^ K*, o (0) is also of constant rank equal 
to e in uj*. 

(5) The image A := ^(c^*) is a piece of ^-analytic submanifold pass- 
ing through the origin enjoying the most important property that 
every vector field L' G L° is tangent to A. If the fiows of all ele- 
ments o/L° are algebraic, A is ^-algebraic. 
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(6) Every local "K-algebraic or K-analytic submanifold A' passing 
trough the origin to which all vector fields L' G L° are tangent 
must contain A in a neighborhood ofO. 

In conclusion, the dimension e of K is characterized by the generic rank 
properties (1) and (2). 

Previously, A was called Nagano leaf. Since the above statement is su- 
perseded by Sussmann's Theorem 1.21(111), we prefer to call it the local 
h-orbit of 0, introducing in advance the terminology of Part III and denot- 
ing it by O^^o{n^_^ , 0). The integer e of the theorem is ^ n, just because the 
target of the maps (ti, . . . , tfc) ^ L;^{- ■ ■ {L*l{0)) ■■■) is K". It follows 
that in (4) and (5) we need 2e — 1 ^ 2n — 1 compositions of flows to cover 
A. 

We quickly mention an application about separate algebraicity. 
In IIBM1949L it is shown that a local K-analytic function g : D^^ ^ K is 
K-algebraic if and only if its restriction to every affine coordinate segment 
is K-algebraic. Call the system minimal at the origin if (9j^o'^(n^^, 0) 
contains a neighborhood of the origin. Equivalently, the integer e of 
Theorem 1.13 equals n. 

Theorem 1.14. ( [|Me2001all )/fL° = {La}i^a^risminimalatO, alocalK- 
analytic function g : — > IK is K-algebraic if and only it its restriction 
to every integral curve of every La G L° is K-algebraic. 

Proof of Theorem 1.13. (May be skipped in a first reading.) If all vector 
fields of L° vanish at the origin, A = {0}. We now exclude this possibility. 
Choose a vector field L*^ G L° which does not vanish at 0. The map 
ti 1-^ -^ti^(O) is of (generic) rank one at every ti G D^^- If there exists 
L' G LP such that the map (ti,t') i— L[,(LI^(0)) is of generic rank two, 
we choose one such L' and we denote it by L*^. Continuing in this way, we 
get vector fields L*^, . . . , L*^ satisfying properties (1) and (2), with e ^ n. 

Since the generic rank of the map (ti, . . . , tg) ^ L*^{- ■ ■ {L*^{0)) • ■ ■ ) 
equals e, and since this map is K-analytic, there exists a t* G arbitrarily 
close to the origin at which its rank equals e. We claim that we can more- 
over choose t* to be of the special form (t^, . . . , t*_i, 0), i.e. with t* = 0. 
It suffices to apply the following lemma to ip{t) := Li^~^{- ■ ■ {L^l (0)) ■ ■ ■ ) 
and to L' := L*\ 

Lemma 1.15. Le? n G N, n ^ 1, /ef e G N, 1 ^ e ^ n, let t G D^^^ and 
let 

□^;i9tH^^(t) = (^i(t),...,^„(t))Gn" 
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be a K-analytic map whose generic rank equals (e — 1). Let L' be a K- 
analytic vector field and assume that the map ip : (t, t') t-^ L[,[ip{t)) has 
generic rank e. Then there exists a point (t*,0) arbitrarily close to the 
origin at which the rank ofip is equal to e. 

Proof. Choose G Dp"^ arbitrarily close to zero at which Lp has maximal 
rank, equal to (e — 1). Since the rank is lower semi-continuous, there exists 
a connected neighborhood cu" of t" in Dp"^ such that </? has rank (e — 1) 
at every point of toK By the constant rank theorem, 11 := >p{uj'^) is then a 
local K-analytic submanifold of D^^ passing through the point (^{1^). To 
complete the proof, we claim that there exists t* G lu'^ arbitrarily close to 
t" such that the map (t, t') t-^ L[, {ip{t)) has rank e at (t*, 0). 

Let us reason by contradiction, supposing that at all points of the form 
(t*,0), for t* G uK the map ip : (t,t') t-^ L[,{(p{t)) has rank equal to 
(e — 1). Pick an arbitrary t* G coK Reminding that when t' = 0, we 
have L[, = Lq = Id, we observe that ^(t, 0) = ^{t). Consequently, the 
partial derivatives of 'ip with respect to the variables tj, i = 1, . . . , e — 1 at 
an arbitrary point (t*, 0), with t* G cuK coincide with the (e — 1) linearly 
independent vectors |^(t*) G K", z = l,...,e — 1. In fact, the tangent 
space to n at the point ?/'(t*,0) = v^(t*) is generated by these (e — 1) 
vectors. 

Reminding the fundamental property ^L[,{x)\^,_q = L'{x), we deduce 
[from our assumption that the map (t, t') t— > L[,((p{t)) has rank equal to 
(e — 1)] that the vector 



must be linearly dependent with the (e — 1) vectors -^(t), i = 1, . . . , e — 
1, for every t E uK Equivalently, the vector field L' is tangent to the 
submanifold 11. It follows that the local flow of L' necessarily stabilizes 
11: if X = (p{t) G n, t G ujK then L[,{x) G 11, for aU t' G where 
p(t) > is sufficiently smaU. Set fi" := {(t,t') : t G cjf,t' G □p(t)i}. 
It is a nonempty connected open subset of D^^. We have thus deduced 
that ^(fi") is contained in the (e — 1) -dimensional submanifold 11 . This 
constraint entails that is of rank ^ e — 1 at every point of QK However, 
^\q» being K-analytic and of generic rank equal to e, by assumption, it 
should be of rank e at every point of an open dense subset of Q,K This is 
the desired contradiction which proves the lemma. □ 



d_ 



t'=0 



L\^{t)) 
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Hence, there exists t* = (t^, . . . , t*„i, 0) e D^^ arbitrarily close to the 
origin at which the rank of t i— > L^^i- ■ ■ (-^ti^(O)) ■ ■ ■ ) is maximal (hence 
locally constant) equal to e, so we get the constant rank property (3), for a 
sufficiently small neighborhood u* of t* . 

In (4), the property A'** ° -^i-(O) = is obvious, using x = Lo(x) = 
L_t oLt(x): 

L% o . . ■ o L%. o^^oL* o . . . o L*. (x) = X. 

Since the map x t-^ K*, (x) is a local diffeomorphism, it is clear that the 
map tp : t i-^ K*, o L^(0) is also of constant rank e in u*. Thus, we 
obtain (4), and moreover, by the constant rank theorem, the image A : = 
^(o;*) constitutes a local K-analytic submanifold of K" passing through 
the origin. If the flows of elements of L° are all K-algebraic, clearly tp and 
A are also K-algebraic. 

It remains to check that every vector field L' E LP is tangent to A. As a 
preliminary, denote by L[,{ip{t)),t E D^^, t' E D^^, the map appearing in 
(2), where L' E L° is arbitrary. Reasoning as in the lemma above, we see 
that L' is necessarily tangent to some local submanifold 11 obtained as the 
local image of an open connected set where ip has maximal locally constant 
rank. It follows that the flows and the multiple flows of elements of LP 
stabilize this submanifold. We deduce a generalization of (2): for k ^ 2n, 
for L' E (L0)\ for t' E D^^, the map (t, t') ^ L[,{L*^{- ■ ■ (4*1(0)) ■ ■ ■ )) 
is of generic rank e. 

In particular, for every L' E L°, the map (t', s, t) i — > L[, o K* o L*(0) is 
of generic rank e. In fact, the restriction ijj : t ^-^ K*, o (0) of this map to 
the open set {(0, s*, t) : t G cj*} is already of rank e at every point and its 
image is the local submanifold A, by the above construction. So the map 
(t', t) I — > L[, o A'*, o A*(0) must be of rank e at every point. In particular, 
the vector 



-^L[,oK:.oLm 



L'{K:,oLm) 



t'=0 



must necessarily be tangent to A at the point A"*, o A*(0) E A. Thus, (5) is 
proved. 

Take A' as in (6). The local flows of all vector L' E L° stabilize A'. 
Shrinking p2 if necessary, all the maps (t, x) i — > At(x) have range in A'. 
So A C A', proving (6). □ 
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§2. Analytic CR manifolds, Segre chains and minimality 

2.1. Local Cauchy-Riemann submanifolds of C". Let (zi, . . . , z„) = 

{xi + iyi, . . . , Xn + iy-n) denote the canonical coordinates on C". As before, 
we use the maximum norms |x| = maxi^^^^ \xk\, \y\ = maxi^fc^„ \yk\ 
and \z\ = maxi^k^n \zk\, where \zk\ = {xl + y'lY^'^- If p > 0, we denote 
by A" = {2; e : |2;| < p} the open polydisc of radius p centered at the 



origin, not to be confused with D^" = {x + iy G C" : \y\ < p}. 

Let J denote the complex structure of TC", acting on real vectors as 
if it were multiplication by Precisely, if p is any point, TpC" is 

spanned by the 2n vectors j^, ^ |^, A; = 1, . . . , n, and J acts as follows: 

axfc \p ~ dyj, Ip' dyk \p ~ dxk \p' 

Choose the origin as a center point and consider a real d-codimensional 
local submanifold M of C" ~ M^" passing through the origin, defined by d 
Cartesian equations ri(x,y) = ■ ■ ■ = rd{x, y) = 0, where the differentials 
dri, . . . , drd are linearly independent at the origin. The functions rj are 
assumed to be of clas^ C^, where TZ = k ^ 1, ^ a ^ 1, 

IZ = 00, IZ = oj or IZ = Alg. Accordingly, M is said to be of class C-^'^ 
(real algebraic), (real analytic), C°° or C'". 

For p E M, the smallest J-invariant subspace of the tangent space TpM 
is given by T^M := TpM fl JTpM and is called the complex tangent space 
to M at p. 

Definition 2.2. The submanifold M is called: 

• holomorphic if TpM = TpM at every point p E M; 

• totally real if T^M = {0} at every point p E M; 

• generic if TpM + JTpM = TpV at every point p E M; 

• Cauchy-Riemann (CR for short) if the dimension of TpM is equal 
to a fixed constant at every point p E M. 

For fundamentals about Cauchy-Riemann (CR for short) structures, 
we refer the reader to IIChl989l IJal990l IChl991[ IBo 19911 IBER1999[ 
IMe2004all . Here, we only summarize some elementary useful properties. 
The two J-invariant spaces TpM n JTpM and TpM + JTpM are of even 
real dimension. We denote by nip the integer | (Mm.^{TpM fl JTpM) and 
call it the CR dimension of M at p. If M is CR, uip = m is constant. Holo- 
morphic, totally real and generic submanifolds are CR, with m = n — \ d, 
m = and m = n — d respectively. If M is totally real and generic. 



^ Background about Holder classes appears in Section 1(IV). 
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dimjR M = n and M is called maximally real. We denote by Cp the integer 
n — ^ diniR (TpM + JTpM) and call it the holomorphic codimension of 
M at p. It is constant if and only if M is CR. Holomorphic, totally real, 
generic and Cauchy-Riemann submanifolds are all CR and have constant 
holomorphic codimensions c=^d, c = d — n, c = and c = d — n + m 
respectively. Submanifolds of class C'" or will be studied in Part III. 

Let M or be a real algebraic (C-^'^) or analytic (C^) submanifold of C"^ 
of (real) codimension d and let po ^ M. There exist complex algebraic 
or analytic coordinates centered at pq and pi > such that M is locally 
represented as follows. 

Theorem 2.3. ( IIChl989[|Bol991llBER1999llMe2004all ) 

• If M is holomorphic, letting m = n — ^d ^ and c := | rf, then 

m + c = n and M = {{z,wi) e A™^ x A^^ : wi = O}. 

• If M is totally real, letting di = 2n — d ^ and 
c = d — n ^ 0, then di + c = n and M = 
{{wi,W2) e D^fi X A;^^ : Imwi = 0,W2 = O}. 

• If M is generic, letting m = d — n, then m + d = n and 

M = {{z,w) G A™ X (D^^ : Imw; = ^{z,z,Rew)} , 

for some M.'^-valued algebraic or analytic map (f satisfying (p{0) = 
whose power series converges normally in A^^ x A^^ x □2pi- 

• IfM /i' Cauchy-Riemann, letting m = CRdimM, c = d—n+m ^ 
0, and di = 2n — 2m — d ^ 0, then m + di + c = n and 

M={{z, w,, W2) e A™ X (D^J + tR'^) X A^^ : 

Imwi = (pi{z, z,Rewi), W2 = O}, 

for some R'^^ -valued algebraic or analytic map (pi satisfying 
(fi (0) = whose power series converges normally in A^^ x A^^ x 

r-\di 

A further linear change of coordinates may yield d(p{0) = and 
d(fi{0) = 0. 

A CR algebraic or analytic manifold being generic in some local com- 
plex manifold of (smaller) dimension n — c, called its intrinsic complexi- 
Hcation, in most occasions, questions, results and articles, one deals with 
generic manifolds. In this chapter, all generic submanifolds will be of pos- 
itive codimension d ^ 1 and of positive CR dimension m. ^ 1. 
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2.4. Algebraic and analytic generic submanifolds and their 
extrinsic complexification. Let M be generic, represented by 
\mw = ip{z, z,Rew). The implicit function theorem applied to the 
vectorial equation = (2;, 2,^^^^), enables to solve the variables 
w E C'^\ or the variables w E C^. This yields the so-called complex 
defining equations for M, most useful in applications, as stated just below. 
Recall that, given a power series = X]7eN" "^7^^' ^ ^ C", $^ E C, 
7 E N", one defines the series := "^7 by conjugating only 

its complex coefficients. Then = ^(t),di frequently used property. 

Theorem 2.5. ( nBER1999[ IMe2004al ) A local generic real algebraic or 
analytic d-codimensional generic submanifold M fl A^^ may be repre- 
sented by w = Q{z, z, w), or equivalently by w = Q{z, z, w), for some 
complex algebraic or analytic C^-valued map O whose power series con- 
verges normally in x A^^ x ^2p^, with pi > 0. Here, 6 and 6 satisfy 
the two {equivalent by conjugation) vectorial functional equations: 

w = Q{z, z, Q{z, z, w)), 
w = Q{z, z, Q{z, z,w)). 

Conversely, if such a -valued map 6 satisfies the above, the set M := 
{{z,w) E A^^ : w = Q{z, z,w)} is a real local generic submanifold of 
codimension d. 

The coordinates (z, w) E C" x will also be denoted by t G C". Let 
= (C) ^ ^ be new independent complex variables. Define the 
extrinsic complexification M. = {My of M to be the complex algebraic 
or analytic d-codimensional submanifold of C" x C" defined by the vec- 
torial equation ^ — <d{(,t) = (the map 6 being analytic, we may indeed 
substitute ( for z in its power series). We also write r = (ty. Observe that 
M identifies with the intersection Ai D {t = i}. 

Lemma 2.6. ( IIMe2004a[ IMe2005l ) There exists an invertible dx d matrix 
a{t,T) of algebraic or analytic power series converging normally in Ag^^ x 
A^p^ such that w - Q{z, r) = a{t, r) - e(C, t)]. 

Thus, Ai is equivalently defined by u; — Q{z, r) = 0. 

2.7. Complexified Segre varieties and complexified CR vector fields. 

Let Tp,tp E A^^ be fixed and define the complexified Segre varieties S^^ 
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and the complexified conjugate Segre varieties S_^^ by: 

5., := {{t, t) e A;^ xA;^: T = r„w = e(z, r,)} 



and 



S,^ := {(t, r) e xA;^: t = t„^ = e(C, tp)} • 



Geometrically, Sr^ = M H {t = Tp} and = fl {t = tp}. We draw 
a diagram. 



{r = Tp} 



The complexification of a real analytic 
generic submanifold carries a pair 
of invariant foliations which are the 
integral submanifolds of the complexified 
(1, 0) and (0, 1) vector fields and which 
identify also with the complexified 
Segre varieties 



Geometry of the extrinsic complexification M 



We warn the reader that 

dime -M. — dime — dime S_^^ = c? ^ 1 , 

so that the ambient codimension d of the unions of and of S. is invis- 
ible in this picture; one should imagine for instance that Jli is the three- 
dimensional physical space equipped with a pair of foliations by horizontal 
orthogonal real lines. 

Next, define two collections of complex vector fields: 



d 



^ ■ dzk ^ dzk ' ' dwj ' 



, m. 



and 



One verifies that Cj. [wj — Qj{z, (, ^)) = 0, which shows that the Ck are 
tangent to M. Similarly, {^j — Qj{C, z, w)) = 0, so the Cf, are also 
tangent to tVI. In addition, [C^, ^k'] = and = for k, k' = 

1, . . . , m, so the theorem of Frobenius applies. In fact, the m-dimensional 
integral submanifolds of the two collections {Ck}i<^k<im and {:^fc}is;fc^m 
are the Srp and the S^^. In summary, Ai carries a fundamental pair of 
foliations. 
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Observe that the vector fields Ck are the complexifications of the vector 
fields Lfe := g|- + Yfj=i ©(^^ ^) a?;-' ^ = 1' • • • ' ^at generate the 
holomorphic tangent bundle T^'°M . A similar observation applies to the 
vector fields C^^. 

In general (unless M is Levi-flat), the total collection {Ck, Ck}i<gti^m. 
does not enjoy the Frobenius property. In fact, the noncommutativity of 
this system of 2m vector fields is at the very core of Cauchy-Riemann 
geometry. 

To apply Theorem 1.13, introduce the "multiple" flows of the two 
collections {£fc}i<;fc^rrt and {^fc}i^fc<m- If p E M has coordinates 
{zp,Wp,Cp.Q e A™ X A^^ X A^ X A^^ satisfying Wp = Q^ZpXp.Q 
and = Q{Cp^ ^p-, '^p) and if zi := . . . , zi^m) G is a small "mul- 
titime" parameter, define the "multiple" flow of C by: 

{zp, Wp, Cp, Q ■■= exp (ziC) (p) 

(2.8) := exp ■ ■ {exp{zi^rnCm{p))) ■■■)) 

■— (^Zp + Zl, Q{Zp + Zl, (^p, ^p), Cp; ^p) • 

Of course, Cz^{p) G M. Similarly, forp G and Ci G C™, defining: 

(2.9) £rc^^{.Zp,WpXp,Q := (zp,u'p,Cp + Ci,0(Cp + Ci,^p,w^p)), 

we have C^^ (p) e M. Clearly, {p, zi) t-^ Cz^ (p) and (p, Ci) ^ C^^-^ (p) are 
complex algebraic or analytic local maps. 

2.10. Segre chains. Let us start from p = being the origin and move 
vertically along the complexified conjugate Segre variety S_q of a height 
zi G C", namely let us consider the point ^^^(0), which we shall also 
denote by £^(2:1). We have £^(0) = 0. Let G C™. Starting from the 
point £^ (zi), let us move horizontally along the complexified Segre variety 
of a length Z2 G C"\ namely let us consider the point 

£2(^1,^2) ■.= CzM.M. 

Next, define £3(2:1, Z2, Z3) := C^^^CziiC^^iO))), and then 
, Z2, 23, 2^4) : — 



and so on. We draw a diagram: 
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By induction, for every A; G N, A; ^ 1, we obtain a local complex alge- 
braic or analytic map ^f,{zi, . . . , Zk), valued in Ai, defined for sufficiently 
small zi, . . . , Zk G which satisfies £^(0, . . . , 0) = 0. The abbreviated 
notation Z(^k) ■= {zi, ■ ■ ■ , Zk) G C'"'^ will be used. The map is called the 
k-th conjugate Segre chain ( nMe2004a[lMe2005H ). 

If we had conducted this procedure by starting with C instead of start- 
ing with C, we would have obtained maps Ti{zi) := Cz^{0), T2{zi^2)) '■ = 
C^^{Cz^{0)), etc., and generally Tk{z(^k))- The map Tk is called the k-th 
Segre chain. 

There is a symmetry relation between Tk and Indeed, let W be the 
antiholomorphic involution of C" x C" defined by W{t, r) := (f, i). Since 
we have w = Q{z, C, if only if = ©(C; -2, w), this involution is a 
bijection of Ai. Applying a to the definitions (2.8) and (2.9) of the flows 
of C and of C, one may verify that ^(^^^(p)) = Cg_^{a(p)). It follows the 
general symmetry relation a (Ti:{z{k))) = Hk (^(ao) • Thus, and have 
the same behavior. 

2.11. Minimality of A4 at the origin and complexified local CR orbits. 

Since 1^(0) = £^(0) = 0, for every integer k ^ 1, there exists 6k > 
sufficiently small such that Tk{z(^k)) and T_kiz(k)) are well defined and be- 
long to A^, at least for all Z(^k) £ ^4^- To fiw ideas, it will be conve- 
nient to consider that A^^ is the precise domain of definition of Tk and 
of Tk- We aim to apply the procedure of Theorem 1.13 to the system 

IL" := . . . , £.rn: • • • ; £1171} ■ 

However, there is a slight (innocuous) difference: each multitime t = 
(ti,...,t) G K'^ had scalar components tj G K, whereas now each 
Zj^k) = {zi, ■ ■ ■ ,Zk) G C"*^' has vectorial components Zi G C™. It is easy 
to see that both Fi and T_i are of constant rank m. Also, both F2 and £2 
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are of constant rank 2m, since £i, . . . , £lii ■ ■ ■ -.^m ^'"^ linearly inde- 
pendent at the origin. However, when passing to (conjugate) Segre chains 
of length ^ 3, it is necessary to speak of generic ranks and to introduce 
some combinatorial integers ^ 1. Justifying examples may be found 
in llMel999>.Me2004al . 

Theorem 2.12. ( [|BER1996[ IBER19991 IMel999l IMe2001al IMe2004aH ) 

There exists an integer uq with 1 ^ uq ^ d and, for k = 3, . . . , z/q + 1, 
integers Cfc with 1 ^ ^ m such that the following nine properties hold 
true. 

(1) For every k = 3, ... ,1^0 + 1, the two maps andV_^ are of generic 
rank equal to 2m + + ■ ■ ■ + Ck- In the special case uq = 1, the 
Cfc are inexisten^ and nothing is stated. 

(2) For every k ^ i^o + l. both Tk andT^ of fixed, stabilized generic 
rank equal to 2m + e, where 

e := 63 H h e^(, ^ d. 

(3) Setting /io := 2uq + 1, there exist two points z*^^^^^-^ G A^'^" and 
4,0) ^ ^citisJyingT,,{zl^^^) = and T^^^Ul^^) = which 
are arbitrarily close to the origin in such that T^^ and F^^ 
are of constant rank 2m + e in neighborhoods uo* and uf of z*^^^ 
andofz*^^^^y The images r^Q(u;*) and Il^^{uf ) then constitute two 
pieces of local K-algebraic or analytic submanifold of dimension 
2m + e contained in M.. 

(4) Both r^j,(u;*) andY^^^{uf) enjoy the most important property that 
all vector fields £i, . . . , Cm, £li, ■ ■ ■ tangent to r^g(ci;*) 
and to r^jj (u;*). 

(5) V ^^{(jj*) and r^(,(cu*) coincide together in a neighborhood ofO in 
M. 

(6) Denoting by 

this common local piece of complex analytic submanifold of J^, it 
is algebraic provided that the flows o/ . . . , Cm, Ci, ■ ■ ■ , Cm^ 
are themselves algebraic. 



One may set ei := m and 62 := m in any case. 
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(7) Every local complex analytic or algebraic submanifold Af C M. 
passing through the origin to which Ci, . . . , C^n, £li^ ■ ■ ■ -.OLm 

all tangent must contain Oc,c{M, 0) in a neighborhood of the ori- 
gin. 

(8) The integers vq, 63, ... , e^g and e are biholomorphic invariants of 
M. 

(9) r^(j(c<j*) and r^p(ci^*) also coincide {in a neighbor- 
hood of the origin) with the Nagano leaf of the system 
{£1, . . . , Cm, £li, ■ ■ ■ , Cm], CIS it was constructcd in Theorem 1.5. 

As in IIMe2004a[ IMe2005ll (with different notations), the integer z/q will 
be called the Segre type of M. 

The "orbit notation" Oc,ci-M , 0) anticipates the presentation and the no- 
tation of Section l(III). We will abandon Lie brackets and Nagano leaves. 

The complex vector fields Lk := + Yfj=i S"*^^'^'^) 9^7' ^ ^ 
1, . . . , m, are tangent to M of equations Wj = Qj{z, z, w), j = 1, . . . ,d; 
their conjugates are also tangent to M ; it follows that the real and imag- 
inary parts Re Lk and Im Lk are also tangent to M. We may then apply 
Theorem 1.13 to the system {Re L^^lm Lk}i^k^m, getting a certain real 
analytic local submanifold Oj^j^{M, 0) of M passing through the origin. 
It will be called the local CR orbit of the origin in M (terminology of 
Part III). 

The relation between Oc,c{M,0) and Oij(M, 0) is as follows 
( [|BER1996[ IMel999[ IMe2001a[ IMe2004all ). Let nt{t,T) := t and 
7rT-(t,r) := r denote the two canonical projections associated to the 
product A;^^ X Let A := {(t,r) G A"^^ x A"^^ : t = i} be the 

antiholomorphic diagonal. Observe that 7rt(An Ai) = M. 

• The extrinsic complexification [C^;^(M, 0)]"" = Oc,c{M, 0). 

• The projection vr^ {A n Oc,ci^, 0)) = Olj:{M, 0). 

Concerning smoothness, a striking subtelty happens: if M is real alge- 
braic, although the local multiple flows of C and of C axe complex alge- 
braic (thanks to their definitions (2.8) and (2.9)), the flows of Re and of 
Im Lfc are only real analytic in general. 

Example 2.13. ( nMe2004all ) For the real algebraic hypersurface of de- 
fined by Imw = vT+^ — 1, the vector field L := + iz\/\ + zz ^ 
generates r^'° M and the flow of 2 Re L involves the transcendent function 
Arcsh. 
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Theorem 2.14. ( [|BER1996[lMe2001all ) The local CR orbit O^ xiM, 0) is 
real algebraic if M is. 

For the proof, assuming M to be real algebraic, it is impossible, because 
of the example, to apply the second phrase of Theorem 1.13 (5) to the sys- 
tem {Re Lk, Im Lk}i^k^m- Fortunately, this phrase applies to the complex- 
ified system {Ck, Ck}ifik<im, whence Oc,ci-M.,0) is algebraic, and then 
the local CR orbit O^ jJ^M, 0) = Tit{An bc,c{M, 0)) is real algebraic. 

Definition 2.15. The generic submanifold M or its extrinsic complexifica- 
tion Ai is said to be minimal at the origin if 0) contains a neigh- 

borhood of in M, or equivalently if Oc,ci-M., 0) contains a neighborhood 
ofOinA^. 

The minimality at the origin of the algebraic or analytic complexified 
local generic submanifold Ai = {MY is a biholomorphically invariant 
property; it neither depends on the choice of defining equations nor on the 
choice of a conjugate pair of systems of complex vector fields {£fc}is;fc^»n 
and spanning the tangent space to the two foliations. 

Minimality at reads e = d in Theorem 2.12. For a hypersurface M, 
namely with d = 1, minimality at is equivalent to z^o = 2. 

2.16. Projections of the submersions and F^ ^. Let /iq = 2z/o + 1 as 
in Theorem 2.12. If Ai is minimal at the origin, the two local holomorphic 
maps 

F,„ and : A^^ Ai 
satisfy T^^{zl^^^) = and £^0(^(^0)) = ^ and they are submersive at z*^^^ 

Consider the two projections 7rt(t,r) := t and nT-(t,T) := r and 
four compositions tt^ (F^,(2;(mo)))' ^^t {Lf,M^^o))) and {T ^^X^m)) ^ 
(£^o(-^(mo)))- Since /iq = 2i^o + 1 is odd, observe that the composi- 
tion £21/0+1 = ■ ■ ) ends with a C and that F2^(j+i = £(• • ■ ) ends with 
a C According to the two definitions of the flow maps, the coordinates 
(Cp) ^p) are untouched in (2.8) and the coordinates (zp, Wp) are untouched 
in (2.9). It follows that 

(£2^0+1(^(2^^0+1))) = T^t {L2uoiH2uo))) and 

TTr (r2i/o+l(2;(2i/o+l))) = {^2uo{Zi2uo))) ■ 

Corollary 2.17. ( nMel999l IBER19991 lMe2004all ) If M is minimal at the 
origin, there exists a integer vq ^ d + 1 {the Segre type ofM at the origin) 
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and there exist points z*2iyo) ^ C^'"''° and z^2uo) ^ C^'^''° arbitrarily close 
to the origin, such that the two maps 

3 ^(2.0) ^ (£2.0(^(2.0))) e and 

are of rank n and send ^{2uo) ^huo) origin. 

§3. Formal CR mappings, jets of Segre varieties 
and cr reflection mapping 

3.1. Complexified CR mappings respect pairs of foliations. Let n' eN 

with n' ^ 1 and let M' C C" be a second algebraic or analytic generic 
submanifold of codimension d' ^ 1 and of CR dimension m' = n'—d' ^ 1. 
Let p' e M'. There exist local coordinates t' = {z', w') e C'"' x C"'' 
centered at p' in which M' is represented by w' = Q'{z', t'), or equivalently 
by w' = Q\z',t'). If {t'Y = t' = (C',f) e C™' X C^', the extrinsic 
complexification is represented by ^' = 0'(C', t'), or equivalently by w' = 
6 {z', t'). We shall denote by 0' the origin of C"'. 

Let t e C" and let h{t) = {hi{t), hn'{t)) G C|tf' be a formal 
power series mapping with no constant term, i.e. h{0) = 0'; it may also 
be holomorphic namely h{t) G Cjt}" , or even (Nash) algebraic. We have 
(h{t)Y = h((ty) = h(r). Define /i^(t,r) := (/i(t)J(r)). 

Set r(t, r) := ^ - e(C, t), set r(r, t) := w - Q{z, r), set r'(t', r') : = 
t - e'(C', t') and set r'(r', t') := w' - Q' {z' , r'). We say that the power 
series mapping his a formal CR mapping from (M, 0) to (M', 0') if there 
exists ad' X d matrix of formal power series b(t, t) such that 

r' {h{t),h{i)) = b{t,t)r{t,t} 

in C|t,t|'^. By complexification, it follows that r' {h{t),h{T)) = 

b{t,T)rit,T) in C|t,rf' , namely r) = (/i(t),%)) maps iM,0) 
formally to {Ai',0'). By Lemma 2.6, there exist two complex analytic 
invertible matrices a{t, r) and a' (t', r') satisfying : 

r r{t, r) ^ a{t, r) r(r, t), r' {f, r') ^ a' {f , r') ¥ (r', t') , 

\r{T,t) = a{T,t)r{t,T), r'(r',t') = a'(r',t') r'(t',r'), 

in C[t, r]°' and in C[t', r']"* . So, to define a complexified formal CR map- 
ping : (A^,0) I— (A^',0'), we get four vectorial formal identities. 
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each one implying the remaining three: 

r'{hit)J{T))^bit,T)rit,T), r'{h{t),hir))^cir,t)r{T,t), 
r'{h{T),h{t)) ^b{T,t)r{T,t), f'{h{T),h{t))^c{t,T)r{t,T). 

Here, we have set c{t, r) := 6(r, t) a{t, r). 

These identities are independent of the choice of local coordinates and 
of local complex defining equations for (M, 0) and for (A/', 0'). Since h 
is not a true point-map, we write h : (M, 0) ^jc- (A/', 0'), the index JF 
being the initial of Formal. If h is convergent, it is a true point-map from a 
neighborhood of in Af to a neighborhood of 0' in M'. 




Complexified formal CR mappings respect pairs of foliations 



If h is holomorphic in a polydisc A^^, pi > 0, its extrinsic complex- 
ification sends both the n-dimensional coordinate spaces {t = est.} 
and {r = est.} to the n'-dimensional coordinate spaces {t' = est.} and 
{r' = est.}. 

Equivalently, maps complexified (conjugate) Segre varieties of the 
source to complexified (conjugate) Segre varieties of the target. Some 
strong rigidity properties are due to the fact that hf^ = {h,h) must respect 
the two pairs of Segre foliations . 

The most important rigidity feature, called the reflection principlJ^ says 
that the smoothness of M, M' governs the smoothness of h: 

• suppose that M and Af are real analytic and that h{t) G C[t]" is 
only formal; statement: under suitable assumptions, h{t) G C{t}"' 
is in fact convergent. 

^ Other rigidity phenomena are: parametrization of CR automorphism groups by a jet 
of finite order, finiteness of their dimension, genericity of nonalgebraizable CR submani- 
folds, genericity of CR submanifolds having no infinitesimal CR automorphisms, etc. 
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• suppose that M and M' are real algebraic and that h{t) G C[t]" is 
only formal; statement: under suitable assumptions, h{t) is com- 
plex algebraic. 

After a mathematical phenomenon has been observed in a special, well 
understood situation, the research has to focus attention on the finest, the 
most adequate, the necessary and sufficient conditions insuring it to hold 
true. 

In this section, we aim to expose various possible assumptions for 
the reflection principle to hold. Our goal is to provide a synthesis 
by gathering various nondegeneracy assumptions which imply reflection. 
For more about history, for other results, for complements and for dif- 
ferent points of view we refer to IIpTTTO ILel977l IWel977[ IWel978[ 
IPil978llDFT978llDW1980llDF1988[|BR1988llBR1990[|DP1993llDPT995l 
IDP19981 IBERT9991 IShSOOOl |B ER2000, Me2 00Tal lMe2002l IHu2001[ 
ISh2003l IDP20031 IRo2003l lMMZ2003bL iER2004l IMe2005ll . 

The main theorems will be presented in §3.19 and in §3.22 below, af- 
ter a long preliminary. In these results, M will always be assumed to be 
minimal at the origin. Corollary 2.17 says already how to use concretely 
this assumption: to show the convergence or the algebraicity of a formal 
CR mapping h : (M, 0) i— >jc- (M', 0'), it suffices to establish that for every 
A; G N, the formal maps i — >r h (tt^ (r^(-2(fc)))) are convergent or 
algebraic. 

Before surveying recent results about the reflection principle (without 
any indication of proof), we have to analyze thoroughly the geometry of 
the target A^' and to present the nondegeneracy conditions both on M' and 
on h. Of course, everything will also be meaningful for sufficiently smooth 
(C°° or local CR mappings, by considering Taylor series. 

These conditions are classical in local analytic geometry and they may 
already be illustrated here with a plain formal map h{t) G C|t]" , not 
necessarily being CR. 

Definition 3.2. A formal power series mapping h : (C"^, 0) t-^jr (C"', 0') 
with components hii(t) G C|t], z' = 1, . . . , n', is called 

(1) imertibleif n' = n and det {[dhij dU^]{Q))i<^i^.i^<^n 7^ 0; 

(2) submersive if n ^ n' and there exist integers 1 ^ < ■ ■ ■ < 
i{n') ^ n such that det ([9/ii'y9ti(i^)](0))i^i;,i/,<;„/ ^ 0; 

(3) finite if the ideal generated by the components hi{t), . . . , hn'(t) is 
of finite codimension in C[t]; this implies n' ^ n; 
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(4) dominating if n ^ n' and there exist integers 1 ^ z(l) < ■ ■ ■ < 
i{n') ^ n such that det([(9/ii/ /9ti(,^)](t))i<ci'^,i^^„/ ^ in C|t]; 

(5) transversal if there does not exist a nonzero power series 



. . . ,4,) e Clt[, . . .,t'J such that Gih{t), K'{t)) = 



It is elementary to see that invertibility implies submersiveness which 
implies domination. Furthermore, if a formal power series is either invert- 
ible, submersive or dominating, then it is transversal. Philosophically, the 
"distance" between finite and dominating or transversal is large, whereas 
the "distance" between invertible and submersive or finite is "small". 

3.3. Jets of Segre varieties and Segre mapping. The target M' concen- 
trates all geometric conditions that are central for the reflection principle. 
With respect to Ai', the complexified conjugate Segre variety associated 
to a fixed t' is 5^, := {((',{') e C"' : ^' = e'(C',t')}- Here, (' is a 
parametrizing variable. For k' E N, define the morphism of k'-th jets of 
complexified conjugate Segre varieties by: 



It takes values in C'"'+^<^'>'»'>'=', with Nd',ni',k' ■= ^^'^Sl?- ^ ^'2^ 



As observed in HDW 198011 , the properties of this morphism govern the 
various reflection principles. We shaU say ( [|Me2004a[ |Me2005ll ) that M' 
(or equivalently A4') is: 

(ndl) Levi non-degenerate at the origin if (p[ is of rank m'+n' at t') = 



(nd2) finitely nondegenerate at the origin if there exists an integer such 
that Lp'j^, is of rank n' + m' at (C, t') = (0', 0'), for k' = E'q, hence 
for aU k' ^ 

(nd3) essentially finite at the origin if there exists an integer i'^ such that 
ip',^, is a finite holomorphic map at (C',^') = (0',0'), for k' = Iq, 
hence for all k' ^ i'^; 

(nd4) Segre nondegenerate at the origin if there exists an integer I'q such 
that the restriction of cp'j^, to the complexified Segre variety S'q (of 
complex dimension m') is of generic rank m', for k' = E'q, hence 
for aU k' ^ fn; 



in 



m 




have of course TTfc/^fc/ o yp'^, = ip'^ . 



(0',0'); 
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(nd5) holomorphically nondegenerate if there exists an integer i'^ such 
that the map Lp'j^, is of maximal possible generic rank, equal to m' + 
n', for k' = i'o, hence for all k' ^ i'^. 

Theorem 3.4. ( [|Me2004all ) These five conditions are biholomorphically 
invariant and: (ndl) =^ (nd2) =^ (nd3) =^ (nd4) =^ (nd5). 

Being not punctual, the last condition (nd5) is the finest: as every con- 
dition of maximal generic rank, it propagates from any small open subet to 
big connected open sets, thanks to the principle of analytic continuation. 
Notably, if a connected real analytic M' is holomorphically nondegenerate 
"at" a point, it is automatically holomorphically nondegenerate "at" every 
point ( llStl996[ IBER1999[lMe2004all ). 

To explain the (crucial) biholomorphic invariance of the jet map (p'^,, 
consider a local biholomorphism t' ^ h'{t') = t", where t', t" G C" , that 
fixes the origin, h[,{t') E C{t'}, /i^,(0') = 0', for i' = l,...,n'. Splitting 
the coordinates t" = {z" , w") G C™' x C^', the image M" may be similarly 
represented by w" = Q"{z" , t") and there exists a. d' x d' matrix b'{t', t') 
of local holomorphic functions such that 

in C{t', r'Y, where r'.,{t\ t') := - Q'.,{C, t') and rj, {t", r") := - 
e;', (C", t"), for j' = 1, . . . , d'. Setting h'{t') := {f'{t'),g'{t')) G C{t'}'"' x 
C{t'Y' and replacing ^' by 6'(C', t') in the above equation, the right hand 
side vanishes identically (since r'(t', r') = ^' — 6'(C', t') by definition) and 
we obtain the following formal identity in C{C', t'}'^ : 

g' ic, e'ic, t')) ^ e" (7'(C', ©'(C, t')), h'{t')) . 

Some algebraic manipulations conduct to the following. 

Lemma 3.5. ( IIMe2004a[ IMe2005ll ) For every f = l,...,d' and every 
j3' G N*" , there exists a universal rational map Q'-, ^, whose expression 
depends neither on A4', nor on h', nor on Ai", such that the following 
identities in C{C', t'} hold true : 

^5(^(/(C',e'(C',0)>'(t')) = 



E Q', ( (d"'} e'., ic', t')) , (d"'^ h[, (c', e'(c', t'))) 
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where the last line defines R'ji^pi by forgetting the jets ofh . Here, the Q'ji^p> 
are holomorphic in a neighborhood of the constant jet 

Some symmetric relations hold after replacing Q', Q", C,', t', f , h' by Q , 

e", z', t', f, h'. 

The existence of R'j, ^, says that the following diagram is commutative : 



where the biholomorphic map R'f.,{{h'Y), which depends on {h'Y, is de- 
fined by its components R'ji^pi for j' = 1, . . . ,d' and ^ k'. Thanks to 
the invertibility of h', the map R'f^,{{h'Y) is also checked to be invertible, 
and then the invariance of the five nondegeneracy conditions (ndl), (nd2), 
(nd3), (nd4) and (nd5) is easily established (' llMe2004all ). 

We now present the Segre mapping of M' . By developing the series 
Q'j,((',t') in powers of we may write the equations of Ai' under the 

form ^'y = Xl7'eN'"' iCV' ©i',7'('^') / = 1, • • • , d'- In terms of such a 
development, the inGnite Segre mapping of M' is defined to be the map- 
ping 

Let k' E N. For finiteness reasons, it is convenient to truncate this infinite 
collection and to define the k'-th Segre mapping of M' by 

where Nd>,n',k' = d^^flfr- ^ we have vr^.^fc. [Syt')] = 
One verifies ( IIMe2004all ) the following characterizations. 

(ndl) M' is Levi non-degenerate at the origin if and only if Q\ is of rank 
n' at t' = 0'. 

(ndl) M' is Enitely nondegenerate at the origin if and only if there exists 
an integer £q such that Q'^, is of rank n' at t' = 0', for all k' ^ i'^. 

(nd3) M' is essentially finite at the origin if there exists an integer i'^ such 
that Q'f^, is a finite holomorphic map at t' = 0', for all k' ^ Iq. 
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(nd4) M' is Segre nondegenerate at the origin if there exists an integer £q 
such that the restriction of Q'f,, to the complexified Segre variety S'^, 
(of complex dimension m') is of generic rank m', for all k' ^ i'^. 

(nd5) M' is holomorphically nondegenerate if there exists an integer i'^ 
such that the map Q'^, is of maximal possible generic rank, equal 
to n', for all k' ^ i'^. 

3.6. Essential holomorphic dimension and Levi multitype. Assume 
now that M' is not nececessarily local, but connected. Denote by the 
smallest integer k' such that the generic rank of the jet mappings (t', r') i— ^ 
J^iS^t' does not increase after k' and denote by m! + ^ m! + n' the 

(maximal) generic rank of (t', r') i— J^f'S^t/. Since w' t-^ ©'(C'j -2', w;') is 
of rank d' according to Theorem 2.5, the (generic) rank of the zero-th order 
jet map satisfies 

genrkc {{f, r') ^ J° 5',, = (C, e'(C', z', w'))) = m' + d' = n'. 

Thus, d' ^ ra'j^j, ^ n'. It is natural to call n'j^j, the essential holomorphic 
dimension of M' because of the following. 

Proposition 3.7. ( IIMe2001al IMe2004all ) Locally in a neighborhood of a 
Zariski-generic point p' e M', the generic submanifold M' is biholomor- 
phically equivalent to the product M'^, x A" ""a/', of a generic submanifold 
M ' p , of codimension d' in C"a/' by a complex polydisc A" ""a/'. 

Generally speaking, we may define Aq ^, := genrkj. ((f, r') 1-^ Jr'^t')~ 
m' = d' and for every /c' = 1, . . . , ^'J^,, 

A',, := genrke [{t\ r') ^ J^iS!,) - genrk^ ((f, r') ^ J'^'r'S!,) . 

One verifies ( llMe2004all ) that A;^^, ^ 1, • • • , A^, j^^, ^ 1. With these 
definitions, we have the relations 

genrkc (^{t', r') ^ J^'S^t') = m + X'^ ^' + K,m' + ■■■ + K'm'^ 
for /c' = 0, 1, . . . , i'j^.p and 

genrkc (if , t') ^ J^'S^t^ =m! + d! + X'^ j^^, + ■ ■ ■ + \^^,m' = m! + n'^,, 
for all k' ^ i'j^, . It follows that 

^M' ^ K,M' + ■■■ + ^i'nM' = ^'m' -d' ^ m'. 
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Theorem 3.8. ( [|Me2004all ) Let M' be a connected real algebraic or ana- 
lytic generic submanifold in C" of codimension d' ^ 1 and ofCR dimen- 
sion m' = n' — d' ^ 1. Then there exist well defined integers n'^j, > d', 
^'m< ^ 0' -^0 w ^ 1' -^'i w ^ 1. • • • . M' ^ -'- '^^^ ^ proper real alge- 
braic or analytic subvariety E' of M' such that for every point p' G M'\E' 
and for every system of coordinates {z', w') vanishing at p' in which M' is 
represented by defining equations Wji = Q'j,{z', t'), j' = 1, . . . , d', then the 
following four properties hold: 

• Aq j^j, = d', d' ^ n\j, ^ n' and £\^, ^ n\j, — d'. 

• For every fc' = 0, 1, . . . , the mapping ofk'-th order jets of the 
conjugate complexified Segre varieties (t', r') Jr'S^t' '■^ of rank 
equal to m' + X'q j^j, + ■ ■ ■ + X'^'^m' at {t'p,,tp,) = (0', 0'). 

• n'j^j, = d' + X[ ]^^, + ■ ■ ■ + XL jyj, and for every k' ^ the 

' M' ' 

mapping ofk'-th order jets of the conjugate complexified Segre va- 
rieties (t', t') I— > J^iS^t' of rank equal to n\.p at (0', 0'). 

• There exists a local complex algebraic or analytic change of co- 
ordinates t" = h' it') fixing p' such that the image M'^, := h'{M') 

is locally in a neighborhood of p' the product M ", x A" ~^mi of 
a real algebraic or analytic generic submanifold of codimension 
d' in C^M' by a complex poly disc A*^ ~"m'. Furthermore, at the 
central point p' G M ' ^ , c C"^/', the generic submanifold Mp, is 
-finitely nondegenerate, hence in particular its essential holo- 
morphic dimension n'j^j,, coincides with n\^,. 

— v' 

In particular, M' is holomorphically nondegenerate if and only ifn'j^j, = 
n' and in this case, M' is finitely nondegenerate at every point of the 
Zariski-open subset M'\E'. 

3.9. CR-horizontal nondegeneracy conditions. As in §3.1, let h = 
h{t) G C|tf' be a formal CR mapping (M, 0) (M',0'). De- 

compose hit) = {f{t),g{t)) G C|tr' X Cltf, as in the splitting 
) G C™' X C^'. Replacing w by 6(2, r) in the fundamental 
identity r' (/^(t), h{t)) = b(T, t) f{T, t), the right hand side vanishes iden- 
tically (since r{T,t) = w — Q{z,t) by definition), and we get a formal 
identity in C|2;, r] : 

g{z,e{z,T)) =0'(/(z,e(^,r)),Mr)). 
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Setting T := 0, we get g{z,Q{z,0)) = e'(/(z, 8(2, 0)), O). In other 
words, h\s^^ maps Sq formally to S'^^,. The restriction h\so coincides with 
the formal map: 

(/ (2, 6(^,0)), e'(/(2,e(^,o)), 0)) gc^'xc^'. 

The rank properties of this formal map are the same as those of its CR- 
horizontal part: 

f{z,e{z,o)) gC'"'. 

The formal CR mapping h is said ( nMe2004all ) to be: 

(crl) CR-inverdble at the origin if m' = m and if its CR-horizontal part 
is a formal equivalence at 2 = 0; 

(cr2) CR-submersive at the origin if m' ^ m and if its CR-horizontal 
part is a formal submersion at 2; = 0; 

(cr3) CR-finite at the origin if m' = m and if its CR-horizontal 
part is a finite formal map at 2; = 0, namely the quotient ring 
C|2;]/ {fk'{z,Q{z,0))i^k%m') is finite-dimensional (the require- 
ment m' = m is necessary for the reflection principle below); 

(cr4) CR-dominadng at the origin if m' ^ m and if there exist inte- 
gers 1 ^ A;(l) < ■ ■ ■ < k{m') ^ m such that the determinant 

det{[d(j)k'Jdzk(k'2)]{z))i<^k[,k'2^m' ^ does not vanish identically 
in C[2;], where := fk'{z,Q{z,0)); 

(cr5) CR-transversal at the origin if there does not exist a nonzero 
formal power series . . . , /^/) e C|/i, . . . , 

such that F' {(f)i{z) , . . . , (pm' {z)) = in Clzj, where 

One verifies ( nMe2004all ) biholomorphic invariance and the four implica- 
tions: 

(crl) (cr2) (cr3) ^ (cr4) ^ (cr5), 

provided that m' = m in the second and in the third. By far, CR- 
transversality is the most general nondegeneracy condition. 

3.10. Nondegeneracy conditions for CR mappings. This subsection ex- 
plains how to synthetize the combinatorics of various formal reflection 
principles published in the last decade. 

As in §3.1, let h'^ : {M, 0) {M', 0) be a complexified formal CR 
mapping between two formal, analytic or algebraic complexified generic 
submanifolds of equations = r{t, r) := ^ — 0((^, t) and = r'(t', t') : = 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 37 

{'-e'(C',^')- By hypothesis, r'(/i(t),M^)) = r) r(t, r)._Denot- 
ing h = {f,g) e C"' X C^', replacing ^ by e(C,t) in r' {h{t) ,h{T)) = 
b{t,T)r{t,T) and developing 6'(/,/i) = XlyeN™' P' we start 

with the following fundamental power series identity in C[C, t]'^ : 

^(C,e(c,t)) = e'(/(c,0(C,t)),M^)) 

^ J2 /(C,e(c,t)r'e;,(Mt)). 

Consider the m complex vector fields Ci, ■ ■ ■ , Cm tangent to Ai that were 
defined in §2.7. For every /5 = {Pi, . . . , Prn) G N"^, define the multiple 
derivation £P = C^^ ■ ■ ■ CJ^ . Applying them to the above d' scalar equa- 
tions, observing that they do not differentiate the variables t = (z, w), we 
get, without writing the arguments: 

for all P e N"", all f = l,...,d' and all {t, r) G M. 

Lemma 3.11. ( llMe2004a[ IMe2005ll ) For every i' = l,...,n' and every 
P G N™, there exists a polynomial Pii^p in the jet j]-''^'/i(r) with coefficients 
being power series in (t, r) which depend only on the defining functions 
— QjiC, t) of M. and which can be computed by means of some combi- 
natorial formula, such that 

C%,(r)=P,,f3 (t,r,jfl/i(r)). 

Convention 3.12. Let k,l E N. On the complexification A4, equipped 
with either the coordinates (z, r) or t), which correspond to either re- 
placing w by Q(z,t) or ^ by 0(C,t), we shall identify (notationally) a 
power series written under the complete form 

R{t,T, j''h{t),fh{T)), 

with a power series written under one of the following four forms: 

. i?(t,c,e(c,t),J'=M^),J'MC,e(c,t))), 
. R{t,c,J'h{t),fh{c,e{C,t)))^ 

• R{z,Q{z,T),T,j''h{z,e{z,T)),fh{T)) , 

• R{z,T,J^h{z,e{z,T)),fh{T)). 
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Thanks to the lemma and to the convention, we may therefore write: 
(3.13) £^[^,v(r) - 0;.,(/(r),/i(t))] =: ^(t, r, /i(r) : hit)) ^ 0, 
for j' = 1, . . . ,d'. Remind that h{t) is not differentiated, since the deriva- 



tions £/ involve only 



1, . . . , n. This is why we write h{t) after 



Furthmerore, the identities "= 0" are understood "on namely 
as formal power series identities in C[C, t] after replacing ^ by 6(C, or 
equivalently, as a formal power series identities in Cfz, r] after replacing 

w by Q{z, t). 

To understand the reflection principle, it is important to observe imme- 
diately that the smoothness of the power series R'j, ^ is the minimum of the 
two smoothnesses of M and of M'. For instance, the power series R'j, ^ 
are all complex analytic if M is real analytic and if M' is real algebraic, 
even if the power series CR mapping h{t) was assumed to be purely formal 
and nonconvergent. By a careful inspection of the application of the chain 
rule in the development of the above equations (3.13) (cf. Lemma 3.11), 
we even see that each R'^, ^ is relatively polynomial with respect to the 
derivatives of positive order {d'^h{T))i^\a\^\/3\- 

3.14. Nondegeneracy conditions for formal CR mappings. In the equa- 
tions (3.13), we replace h{t) by a new independent variable t' G C" , we 
set (t, r) = (0, 0), and we define the following collection of power series 



f=T=0 



for f = l,...,d' and (3 e N"". Here, if /3 = 0, we mean that %>^oit') = 
—<d'j,{0,t'). According to (3.13), an equivalent definition is: 

VI/;.,, (0 :=i?;.,,(o,o,4^iMo): t')- 

Now, just before introducing five new nondegeneracy conditions, we make 
a crucial heuristic remark. When n = n' , m = m', M = M' and h = 
Id, writing T' instead of t' the special variable above in order to avoid 
confusion, we get for j' = 1, . . . , d' and /?' G : 



J t'= 



(e;.,,,(oo-e;.,,,(T')). 
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Consequently, up to a translation by a constant, we recover with \E^^, p,{T') 
the components of the infinite Segre mapping Q'^ of M' . Hence the next 
definition generalizes the concepts introduced before. 

Definition 3.15. The formal CR mapping h : (M, 0) -^^ (M', 0') is called 
(hi) Levi-nondegenerate at the origin if the mapping 

is of rank n' at t' = 0'; 

(h2) finitely nondegenerate at the origin if there exists an integer ii such 
that the mapping 

t'^(i?;,,(o,o,jfiMo):tO)i^,,^,,i,i^, 

is of rank n' at t' = 0', for k = ii, hence for every k ^ ii, 

(h3) essentially finite at the origin if there exists an integer ii such that 
the mapping 

t'^(i?;.,,(o,o,jfMo):tO),^^.,^,,i,i^, 

is locally finite at t' = 0', for k = ii, hence for every k ^ ii; 
(h4) Segre nondegenerate at the origin if there exist an integer ii, inte- 
gers j'/, . . . .j'J' with 1 ^ j'^^ ^ d! fox i' = 1, . . . , n' and multi- 
indices Pi, . . . ,(3f with I/?*' I ^ £1 for z' = 1, . . . , n', such that the 
determinant 

fdR' , . _ . _ 

det l^gi^^, e(^,o),o,o,ji^''i/i(o): M^,e(^,o)) 

does not vanish identically in Cfz} ; 
(h5) holomorphically nondegenerate at the origin if there exists an inte- 
ger £1, integers ji^, . . . J'/^ with 1 ^ j'/ ^ for z' = 1, . . . , n' 
and multiindices (3}, ... ,(3 f with | ^ £1 for z' = 1, . . . , n', such 
that the determinant 

'OR' 



det 1^ (^0,0,0,0,jl^'^lMO): ^t) 

does not vanish identically in C[t]. 



l^i'l ,i'2 i^n' 
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The nondegeneracy of the formal mapping h requires the same nonde- 
generacy on the target (M', 0'). 

Lemma 3.16. ( [IMe2004aH ) Let h : (M, 0) -^^ (M', 0') be a formal CR 
mapping. 

(1) If h is Levi-nondegenerate at 0, then M' is necessarily Levi- 
nondegenerate at 0'. 

(2) If h is finitely nondegenerate at 0, then M' is necessarily finitely 
nondegenerate at 0'. 

(3) Ifh is essentially finite at 0, then M' is necessarily essentially finite 
at 0'. 

(4) Ifh is Segre nondegenerate at 0, then M' is necessarily Segre non- 
degenerate at 0'. 

(5) If h is holomorphically nondegenerate at 0, then M' is necessarily 
holomorphically nondegenerate at 0'. 

We now show that CR-transversality of the mapping h insures that it 
enjoys exactly the same nondegeneracy condition as the target (Af, 0'). 

Theorem 3.17. ( [|Me2004all ) Assume that the formal CR mapping h : 
(M, 0) — >jc- (M',0') is CR-transversal at 0. Then the following five im- 
plications hold: 

(1) If M' is Levi nondegenerate at 0', then h is finitely nondegenerate 
at 0. 

(2) If M' is finitely nondegenerate at 0', then h is finitely nondegener- 
ate at 0. 

(3) IfM' is essentially finite at 0', then h is essentially finite at 0. 

(4) If M' is Segre nondegenerate at 0', then h is Segre nondegenerate 
at 0. 

(5) If M' is holomorphically nondegenerate, and if moreover h is 
transversal at 0, then h is holomorphically nondegenerate at 0. 

The above five implications also hold under the assumption that h is 
either CR-invertible, or CR-submersive, or CR-finite with m = m! ox CR- 
dominating: this provides at least 20 more (less refined) versions of the 
theorem, some of which appear in the literature. 

Other relations hold true between the nondegeneracy conditions on h 
and on the generic submanifolds (M, 0) and (A/', 0'). We mention some, 
concisely. As above, assume that h : (Af, 0) t-^jr (Af', 0) is a formal CR 
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mapping. Since dh^iT^M) C T^M' , a linear map rf/i*" : TqM/T^M 
TqM' /TqM' is induced. Assume d! = d and m' = m. The next statement 
may be interpreted as a kind of Hopf Lemma for CR mappings. 

Theorem 3.18. ( nBR1990[ER2004ll ) If M is minimal at and ifh is CR- 

dominating at 0, then dhQ^ : TqM/TqM —>■ TqM' /TqM' is an isomor- 
phim. 

An open question is to determine whether the condition that the jacobian 
determinant det j<„ does not vanish identically in C|t] is suffi- 

cient to insure that rf/i*" "ToM/TqW TqM'/T^M' is an isomorphism. 
A deeper understanding of the constraints between various nondegeneracy 
conditions on h, M and M' would be desirable. 

3.19. Classical versions of the reflection principle. Let h : (M, 0) 

(M', 0) be a formal power series CR mapping between two generic sub- 
manifolds. Assume that M is minimal at 0. 

Theorem 3.20. ( IIBER1999[ IMe2004al IMe2005ll ) // M and M' are real 
analytic, if h is either Levi nondegenerate, or finitely nondegenerate, or 
essentially finite, orSegre nondegenerate at the origin, then h{t) is conver- 
gent, namely h{t) G C{t}" . If moreover, M and M' are algebraic, then h 
is algebraic. 

If one puts separate nondegeneracy conditions on h and on M', as in 
Theorem 3.17, one obtains a combinatorics of possible statements, some 
of which appear in the literature. 

If h is finitely nondegenerate (level (2)), the (paradigmatic) proof yields 
more information. 

Theorem 3.21. ( IIBER19991 IMe2005ll ') As above, let h : (M, 0) ^ 

(M', 0') be a formal power series CR mapping. Assume that M is min- 
imal at and let uq be the integer of Corollary 2. 1 7. Assume also that h 
is ii-finitely nondegenerate at 0. Then there exists a -valued power se- 
ries mapping H(t, J^i'o^i^ which is constructed algorithmically by means 
of the defining equations of (M, 0) and of (M', 0'), such that the power 
series identity 

h{t) = H{t,J^'''''h{0)) 

holds in C|t]" . IfM and M' are real analytic (resp. algebraic), H is holo- 
morphic (resp. complex algebraic) in a neighborhood of Q x J^^^'^^hif)). 
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In I1BER1999[|GM2004L the above formula h{t) = H{t, J^^^^^hiO)) is 
studied horoughly in the case where M' = M and his a local holomorphic 
automorphism of (M, 0) close to the identity. 

At level (5), namely with a holomorphically nondegenerate target 
(M', 0'), the reflection principle is much more delicate. It requires the in- 
troduction of a new object, whose regularity properties hold in fact without 
any nondegeneracy assumption on the target (M', 0'). 

3.22. Convergence of the reflection mapping. The rejection mapping 
associated to h and to the system of coordinates {z' , w') is : 

Kir',t) :=e'-e'(C',Mi))eC|r',tf'. 

Since h is formal, it is only a formal power series mapping. As argued in 
the introduction of [|Me2005l l. it is the most fundamental object in the ana- 
lytic reflection principle. In the case of CR mappings between essentially 
finite hypersurfaces, the analytic regularity of the reflection mapping is 
equivalent to the extension of CR mappings as correspondences, as studied 
in [|DP1995[ [Sh2000l ISh2003l IDP2003II . Without nondegeneracy assump- 
tion on (M', 0'), the reflection mapping enjoys regularity properties from 
which all analytic reflection principles may be deduced. Here is the very 
main theorem of this Section 3. 

Theorem 3.23. ( [|Me2001b[ rBMR2002[ lMe2005ll ) If M is minimal at the 
origin and if h is either CR-invertible, or CR-submersive, or CR-finite, or 
CR-dominating, or CR-transversal, then for every system of coordinates 
{z', w') G C™ X in which the extrinsic complexification Ai' is repre- 
sented by ^' = 6'(C', t'), the associated CR-reflection mapping is conver- 
gent, namely TZ'iXt' ,t) G C{r',t}'^'. 

If the convergence property holds in one such system of coordinates, it 
holds in all systems of coordinates ( [|Me2005ll : Proposition 3.26 below). 
Further, if we develope 9'(C',t') = ^ygj^m' (C')^' ©yl^')' the conver- 
gence of TZ'fiir', t) has a concrete signification. 

Corollary 3.24. All the components Qy{h(t)) of the reflection mapping 
are convergent, namely 6y(/i(t)) G C{tY' for every 7' G N"^'. 

Conversely ( IIMe2001b[|Me2005ll ). ife'y{h{t)) G C{tY' for every 7' G 
N™', an elementary application of the Artin approximation Theorem 3.28 
(below) yields Cauchy estimates: there exist p > 0, > and C > so 
that \e'y{h{t))\ < C (p)~l^'l, for every t G C" with \t\ < a. It follows that 
n',iT\t)eC{r',tr'. 
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Taking account of the nondegeneracy conditions (ndi) and (crj), several 
corollaries may be deduced from the theorem. Most of them are already ex- 
pressed by Theorem 3.20, except notably the delicate case where (M', 0') 
is holomorphically nondegenerate. 

Corollary 3.25. ( IIMe2001bl IMe2005ll ) If M is minimal at the origin, if 
(M', 0') is holomorphically nondegenerate and ifh is either CR-invertible 
and invertible, or CR-submersive and submersive, or CR-finite and finite 
with m' = m, or CR-dominating and dominating, or CR-transversal and 
transversal, then h(t) G C{t}" is convergent. 

It is known ( ||Stl996ll ) that (M', 0') is holomorphically degenerate if and 
only if there exists a nonzero (1,0) vector field X' = X]i'=i '^i'i^')w' 

i' 

having holomorphic coefficients which is tangent to (M',0'). In the 
corollary above, holomorphic nondegeneracy is optimal for the conver- 
gence of a formal equivalence: if M' is holomorphically degenerate, if 
(s',t') I — > exp(s'X')(f) denotes the local flow of X', where s' e C, 
t' e C"', there indeed exist ( nBER1999[ IMe2005ll ) nonconvergent power 
series w'{t') G C|t'] such that t' t-^jr exp{zu'{t')X'){t') is a nonconvergent 
formal equivalence of M'. 

The invariance of the reflection mapping is crucial. 

Proposition 3.26. ( [|Me2002[ IMe2004al IMe2005ll ) The convergence of 
the reflection mapping is a biholomorphically invariant property. More 
precisely, if t" = (f)'{t') is a local biholomorphism flxing 0' and trans- 
forming (M', 0') into a generic submanifold {M", 0') of equations w'-, = 
Q'j,{z", t"), j' = 1, . . . , d', the composed reflection mapping of cp' o h : 
(M, 0) (M", 0') deflned by 

K'okir",t):=C-e"{CA'm)) 

= r- E (Cr0y(0'(Mt))) 

has components Q", given by formulas 

e;(0'(Mt))) = 5;,((e;,(Mt)))^,^^,„,), 

where the local holomorphic functions S'y depend only on the biholomor- 
phism t" = (they have an inflnite number of variables, but the neces- 
sary Cauchy estimates insuring convergence are automatically satisfled). 
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A few words about the proof of the main Theorem 3.23. Akhough 
the classical reflection principle deals only with the "reflection identi- 
ties" (3.13), to get the most adequate version of the reflection principle, 
it is unavoidable to understand the symmetry between the variables t and 
the variables r = (iy. 

The assumption that h"^ maps formally (Ai, 0) to (Ai', 0') is equivalent 
to each one of the following two formal identities: 

^9{r) = E Jirr'Q'yihm 

7'eN™' 

7'GN'"' 

on Ai, namely after replacing either w hy Q{z,t) or ,^ by Q{(,t). The 
symmetry may be pursued by considering the two families of derivations: 

£^:={C^f^{Ciy^---{Cm)^- and 

where (3 = (/3i,/32, • • • ,/3m) G N"*. Applying them to the two formal 
identities above, if we respect the completeness of the combinatorics, we 
will get four families of rejection identities. The first pair is obtained by 
applying to the two formal identities above: 

7'eN'"' 

The second pair is obtained by applying C^, permuting the two lines: 

J 7'eN'"' 

= Y 7{ry' [e'y{h{t))] . 

We immediately see that these two pairs are conjugate line by line. In 
each pair, we notice a crucial difference between the first and the second 

line: whereas it is g and the power (or g and j"^') that are differentiated 
in each first line, in each second line, only the components Qyih) (or 
Q' ,{h)) of the reflection mapping, which are the right invariant functions. 
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are differentiated. In a certain sense, it is forbidden to differentiate g and 

—7' / 

/ (or g and /''' ), because the components (/, g) of h need not enjoy a 
reflection principle. In fact, in the proof of the main Theorem 3.23, one 
has to play constantly with the four reflection identities above. 

Since we cannot summarize here the long and refined proof, we only 
formulate the main technical proposition. Denote by J^il) the ^-th jet of a 
power series il){t) G Clt]*^ , for instance J/6y (/i) for some 7' G N™'. Re- 
mind that and are (conjugate) Segre chains. Let iV^' „ £ := d! ^^^f|^. 

Proposition 3.27. ( llMe2005ll ) For every G N and every £ G N, the 
following two properties hold: 

• ifk is odd, for every 7' G N™': 

[J^e'yih)] (r,(z(,))) GC{^(.)}^'^W; 

• ifk is even, for every 7' G N™': 

j^e;,(/^)] (r, (^(,))) G c{^(.)}^'''-^ 

With £ = and k = 2uq, thanks to Corollary 2.17, we deduce from this 
main proposition that 6y G C{t}'^ for every 7' G N™ . This yields 

Theorem 3.23. 

The main tool in the proof of this proposition is an approximation theo- 
rem saying that a formal power series mapping that is a solution of some 
analytic equations may be corrected so as to become convergent and still a 
solution. 

Theorem 3.28. (Artin llArl968llJoPt2000ll ') Le? K = M or C, let n e N 

with n 1, let X = (xi, . . . , x„) G K", let m G N, with m ^ 1, let y = 
(Yi, . . . , Ym) G K", let d G N with d ^ 1 and let i?i(x, y), . . . , Rdix, y) 
be an arbitrary collection of formal power series in ]K{x, y} that vanish at 
the origin, namely Rj{0, 0) = 0, j = 1, . . . , d. Assume that there exists a 
formal mapping h{x) = (/ii(x), . . . , hm(y^)) G K[x]™ with h{0) = such 
that 

Rj (x, h{x)) = in K|x], for j = 1, . . . , d. 

Let tn(x) := xi]K|x] + ■ ■ ■ +x,„K|x] be the maximal ideal o/K|x]. For every 
integer N ^ 1, there exists a convergent power series mapping h'^{x) G 
K{x}"' such that 

Rj (x, h^ix)) = in Klx], for j = 1, . . . , d, 
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that approximates h{x) to order N — 1: 

h^{x) = h{x) mod (m(a;)^) . 

As an application of the main Theorem 3.23, an approximation property 
for formal CR mappings holds. 

Theorem 3.29. ( IIMe2005ll ) Under the assumptions of Theorem 3.23, for 
every integer N ^ 1, there exists a convergent power series mapping 
H^(t) G C{t}"' with H^{t) = hit) mod(m(t))^ {whence H{0) = 0), 
that induces a local holomorphic map from (M, 0) to [M', 0'). 

Corollary 3.30. ( IIMe2001b[IMe2005H ) Assume that n' = n, that d' = d, 
that M is minimal at the origin, and that h : (M, 0) — >jc- (M', 0') is a 
formal (invertible) equivalence. Then M and M' are biholomorphically 
equivalent. 

It is known ( nStl996[ IBER1999[ IGM2004II ') that a minimal holomor- 
phically nondegenerate real analytic generic submanifold of C" has finite- 
dimensional local holomorphic automorphism group. Unique determina- 
tion by a jet of finite order follows from a representation formula, as in 
Theorem 3.21. More generally: 

Corollary 3.31. ( [|Me2001bl rBMR2002[ lMe2005ll ) Assume that m' = m 
and d' = d, that (M, 0) is minimal at the origin and that (M', 0) is holo- 
morphically nondegenerate. There exists an integer k, = K{m, d) such that, 
if two local biholomorphisms h^, h"^ : (M, 0) (M', 0) have the same k- 
th jet at the origin, then = h"^. 

From an inspection of the proof. Theorem 3.29 holds without the as- 
sumption that (M, 0) is minimal, but with the assumption that its CR orbits 
have constant dimension in a neighborhood of 0. However, the case where 
CR orbits have arbitrary dimension is delicate. 

Open question 3.32. Does formal equivalence coincide with biholomor- 
phic equivalence in the category of real analytic generic local submani- 
folds o/C" whose CR orbits have non-constant dimension ? 

3.33. Algebraicity of the reflection mapping. We will assume that both 
M and M' are algebraic. Remind that Theorem 3.20 shows the algebraic- 
ity of h under some hypotheses. A much finer result is as follows. It 
syntheti zes all existing results ( IIWel977l ISS 19961 ICMS 19991 IBER1999[ 
IZa 199911 ) about algebraicity of local holomorphic mappings. 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



47 



Theorem 3.34. ( HMelOOlalD If h is a local holomorphic map (M, 0) 
(M', 0'), if M and M' are algebraic, if M is minimal at the origin and if 
M' is the smallest (for inclusion) local real algebraic manifold containing 
h{M), then the reflection mapping TZ\^{t' ^ t) is algebraic. 

Trivial examples ( IIMe2001all ) show that the algebraicity of TZ',^ need not 
hold if M' is not the smallest one. 

In fact, Theorem 3.34 also holds (with the same proof) if one assumes 
only that the source M is minimal at a Zariski-generic point: it suffices 
to shrink M and the domain of definition of h around such points, getting 
local algebraicity of TZ'f^ there, and since algebraicity is a global property, 
TZ'fi^ is algebraic everywhere. 

An equivalent formulation of Theorem 3.34 uses the concept of tran- 
scendence degree, studied in [|Pul990[ ICMS1999llMe200Tal . With n'j^j, 
being the essential holomorphic dimension of (M', 0') defined in §3.6, set 
k'j^j, := n' — n\p. Observe that (Af, 0') is holomorphically nondegenerate 
precisely when k'j^, = 0. Denote by C[t] the ring of complex polynomials 
of the variable t e C" and by C(t) its quotient field. Let t' = h{t) be a local 
holomorphic mapping as in Theorem 3.34. and let C(t)(/ii(t), . . . , hn'{t)) 
be the field generated by the components of h. 

Theorem 3.35. ( IIMe2001all ) With the same assumptions as in The- 
orem 3.34, the transcendence degree of the field extension C(t) 
C(t){h{t)) is less than or equal to k'^^. 

Corollary 3.36. ( IICMS 19991 IZal999l IMe2001all ) // M is minimal at a 
Zariski-generic point and if the real algebraic target M' does not contain 
any complex algebraic curve, then the local holomorphic mapping h is 
algebraic. 

However, in case h is only a formal CR mapping, it is impossible to 
shift the central point to a nearby minimal point. Putting the simplest rank 
assumption (invertibility) on h, we may thus formulate delicate problems 
for the future. 

Open question 3.37. Let h be a formal equivalence between two real an- 
alytic generic submanifolds ofC'' which are minimal at a Zariski-generic 
point. 

• Is the refiection mapping convergent ? 

• Is h uniquely determined by a jet of finite order when the target is 
holomorphically nondegenerate ? 
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• Is h convergent under the assumption that the real analytic target 
M' does not contain any complex analytic curve ? 

For M' algebraic containing no complex algebraic curve and M min- 
imal at 0, the third question has been settled in [|MMZ2003bll . How- 
ever, the assumption of algebraicity of M' is strongly used there, be- 
cause these authors deal with the transcendence degree of the field ex- 
tension C(t) C{t){h{t)), a concept which is meaningless if M' is 
real analytic. For further (secondary) results and open questions, we 
refer to [|BMR2002[ IRo2003H . This closes up our survey of the for- 
mal/algebraic/analytic reflection principle. 

A generic submanifold M C C" is called locally algebraizable at one 
of its points p if there exist local holomorphic coordinates centered at p in 
which it is Nash algebraic. Unlike partial results, the following question 
remains up to now unsolved. 

Open problem 3.38. ( IIHu2001l IHJY20011 IJi2002l IGM2004[ IFo2004ll ') 
Formulate a necessary and sufficient condition for the local algebraizabil- 
ity of a real analytic hypersurface M C C" in terms of a basis of the 
(differential) algebra of its Cartan-Hachtroudi-Chern invariants. 

To conclude, we would like to mention that the complete theory of CR 
mappings may be transferred to systems of partial differential equations 
having finite-dimensional Lie symmetry group. This aspect will be treated 
in subsequent pubUcations ( [|Me2006al |Me2006bll ). 
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III: Systems of vector fields and CR functions 



Beyond the theorems of Fiobenius and of Nagano, Sussmann's theorem pro- 
vides a means, vahd in the smooth category, to construct all the integral manifolds 
of an arbitrary system of vector fields, as orbits of the pseudo-group actions of 
global flows. The fundamental properties of such orbits: lower semi-continuity of 
dimension, local flow box structure, propagation of embeddedness, intersection 
with a transversal curve in the one-codimensional case, are essentially analogous, 
but different from the ones known in foliation theory. Orbits possess wide appli- 
cations in Control Theory, in sub-Riemannian Geometry, in the Analysis of Linear 
Partial Differential Equations and in Cauchy-Riemann geometry. 

Let Ljf = gj,j = 1, . . . , A, be a linear PDE system with unknown /, where 
g is smooth and where {Lfcji^fc^r is an involutive (in the sense of Frobenius) 
system of smooth vector fields on M" having complex-valued coefficients. Since 
Lewy's celebrated discovery of an example of a single equation Lf = ginW^ 
without any solution, a major problem in the Analysis of PDE's is to find ade- 
quate criterions for the existence of local solutions. Condition (P) of Nirenberg- 
Treves has appeared to be necessary and sufficient to insure local integrability of 
a single equation of principal type having simple characteristics. The problem of 
characterizing systems of several linear first order PDE's having maximal space 
of solutions is not yet solved in full generality; several fine questions remain open. 

Following Treves, to abstract the notion of systems involving several equa- 
tions, an involutive structure on a smooth ^-dimensional real manifold M is 
a A-dimensional complex subbundle £ of C ® TM satisfying [C,C] C C. 
The automatic integrability of smooth almost complex structures (those with 
C ® C = C (8) TM) and the classical (non)integrability theorems for smooth 
abstract CR structures (those with C r\ C = {0}) ai^e inserted in this general 
framework. 

Beyond such problematics, it is of interest to study the analysis and the geome- 
try of subbundles C whose space of solutions is maximal, viz the preceding ques- 
tion is assumed to be solved, optimally: in a neighborhood of every point of M, 
there exist (^u — A) local complex valued functions zi, . . . , z^-a having linearly 
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independent differentials which are solutions of Czk = 0. Such involutive struc- 
tures are called locally integrable. Some representative examples are provided by 
the bundle of anti-holomorphic vector fields tangent to various embedded generic 
submanifolds of According to a theorem due to Baouendi-Treves, every lo- 
cal solution of £/ = may be approximated sharply by polynomials in a set of 
fundamental solutions zi, . . . , 2;^_a, in the topology of functional spaces as C*'", 

In a locally integrable structure, the Sussmann orbits of the vector fields 
Re Lfc, Im L/c ai^e then of central importance in analytic and in geometrical ques- 
tions. They show up propagational aspects, as for instance: the support of a func- 
tion or distribution solution / of £/ = is a union of orbits. The approximation 
theorem also yields an elegant proof of uniqueness in the Cauchy problem. Fur- 
ther propagational aspects will be studied in the next chapters, using the method 
of analytic discs. Sections 3, 4 and 5 of this chapter and the remainder of the 
memoir ai^e focused on embedded generic submanifolds. 

§1. Sussmann' s theorem and structural properties 

OF ORBITS 

1.1. Integral manifolds of a system of vector fields. Ordinary differential 
equations in the modem sense emerged in the seventieth century, concomi- 
tantly with the infinitesimal calculus. Nowadays, in contemporary mathe- 
matics, the abstract study of vector fields is inserted in several broad areas 
of research, among which we perceive the following. 

• Control Theory: controllability of vector fields on C°° and real 
analytic manifolds; nonholonomic systems; sub-Riemannian ge- 
ometry ( [|GV1987[|BelT996l ). 

• Dynamical systems: singularities of real or complex vector 
fields and foliations; normal forms and classification; phase di- 
agrams; Lyapunov theory; Poincare-Bendixson theory; theory of 
limit cycles of polynomial and analytic vector fields; small divi- 
sors ( IIArl978[|ArTM8l ). 

• Lle-Cartan theory: infinitesimal symmetries of differential equa- 
tions; classification of local Lie group actions; Lie algebras of vec- 
tor fields; representations of Lie algebras; exterior differential sys- 
tems; Cartan-Vessiot-Kahler theorem; Janet-Riquier theory; Car- 
tan's method of equivalence ( IIO11995l[S&2000ll ). 

• Numerical analysis: systems of (non)linear ordinary differential 
equations; methods of: Euler, Newton-Cotes, Newton-Raphson, 
Runge-Kutta, Adams-Bashforth, Adams-Moulton ( nDel996l ). 
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• PDE theory: Local solvability of linear partial differential equa- 
tions; uniqueness in the Cauchy problem; propagation of singu- 
larities; FBI transform and control of wave front set ( I1ES1993[ 
nYvT992ll ). 

To motivate the present Part III, let us expose informally two dual questions 
about systems of vector fields. Consider a set L of local vector fields de- 
fined on a domain of W\ Frobenius' theorem provides local foliations by 
submanifolds to which every element of L is tangent, provided L is closed 
under Lie brackets. However, for a generic set L, the condition [L, L] C L 
fails and in addition, the tangent spaces spanned by elements of L are of 
varying dimension. To surmount these imperfections, two inverse options 
present themselves: 

Sub: find the subsystems L' C L which satisfy Frobenius' condition 
[L', L'] C L' and which are maximal in an appropriate sense; 

Sup: find the supsy stems L' D L which have integral manifolds and 
which are minimal in an appropriate sense. 
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Searching for integrable sub- or sup- systems 



The first problem Sub is answered by the Cartan- Vessiot-Kahler the- 
orem, thanks to an algorithm which provides all the minimal Frobenius- 
integrable subsystems L' of L (we recommend [|Stk2000l l for a presen- 
tation). Generically, there are infinitely many solutions and their cardi- 
nality is described by means of a sequence of integers together with the 
so-called Cartan character of L. In the course of the proof, the Cauchy- 
Kowalevskaya integrability theorem, valid only in the analytic category, is 
heavily used. It was not a serious restriction at the time of E. Cartan, but, 
in the second half of the twentieth century, the progress of the Analysis of 
PDE showed deep new phenomena in the differentiable category. Hence, 
one may raise the: 

Open problem 1.2. Find versions of the Cartan-Vessiot-Kdhler theorem, 
for systems of vector fields having smooth non-analytic coefficients. 
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The Cauchy characteristic subsystem of L ( [|Stk2000ll ) is always invo- 
lutive, hence the smooth Frobenius theorem applies to ilQ. However, for 
intermediate systems, the question is wide open. Possibly, this question is 
related to some theorems about local solvability of smooth partial differen- 
tial equations (cf. Section 3) that were established to understand the Hans 
Lewy counterexample (§3.1). 

The second problem Sup is already answered by Nagano's theorem 
(Part II), though only in the analytic category, with a unique integrable 
minimal supsystem L^"^ D L. In the general smooth category, the stronger 
Chevalley-Lobry-Stefan-Sussmann theorem, dealing with flows of vector 
fields instead of Lie brackets, shows again that there is a unique integrable 
sup-system of L which has integral manifolds. As this theorem will be 
central in this memoir, it will be exposed thoroughly in the present Sec- 
tion 1. 

1.3. Flows of vector fields and their regularity. Let K = M or C. Let 

D be a open connected subset of K". Let x = (xi, . . . ,x„) G D. Let 
L = XliLi '^j(^) ^ tie a vector field defined over D. Throughout this 
section, we shall assume that its coefficients cij are either K-analytic (of 
class C^), of class C°°, or of class C'", where k ^ 1 and ^ « ^ 1 (see 
Section 1(IV) for background about Holder classes). 

By the classical Cauchy-Lipschitz theorem, through each point xq G D, 
there passes a unique local integral curve of the vector field L, namely a lo- 
cal solution x(t) = (xi(t), . . . , x„(t)) of the system of ordinary differential 
equations: 

dxi{t)/dt = ai(x(t)), , dxn{t)/dt = a„(x(t)), 

which satisfies the initial condition x(0) = xq. This solution is defined 
at least for small t G K and is classically denoted by t i-^ exp(tL)(xo), 
because it has the local pseudogroup property 

exp(t'L)(exp(tL)(xo)) = exp ((t + t')i:) (xq), 

whenever the composition is defined. Denote by r2xo the largest connected 
open set containing the origin in K in which exp(tL)(xo) is defined. One 
shows that the union of various f2xo' for running in D, is an open con- 
nected set of K X K" which contains {0} x D. Some regularity with 
respect to both variables t and xq is got automatically. 

Theorem 1.4. ( llLal983L [*]) The global flow VLl 3 (t,xo) ^ 
exp(tL)(xo) & D of a vector fleld L = '2i(x)^xi deflned in the 



We are grateful to Stormark for pointing out this observation 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



53 



domain D has exactly the same smoothness as L, namely it is C^, C°° or 

As a classical corollary, a local straightening property holds : in a neigh- 
borhood of a point at which L does not vanish, there exists a C^, C°° or C^ " 
change of coordinates x' = x'(x) in which the transformed vector field is 
the unit positive vector field directed by the x'^ lines, viz L' = d/dx[. 

Up to the end of this Section 1, we will work with K = M. 

1.5. Searching integral manifolds of a system of vector fields. Let M 

be a smooth paracompact real manifold, which is C^, or C"*"^'", where 
K^l, O^a^l. Let L := {La}aeA be a collection of vector fields 
defined on open subsets Da of M and having C^, or C'" coefficients, 
where A is an arbitrary set. It is no restriction to assume that Ua^A Da = 
M, since otherwise, it suffices to shrink M. Call L a system of vector 
fields on M. 

Problem 1.6. Find submanifolds N of M such that each element ofh is 
tangent to N. 

To analyze this (still imprecise) problem, let ¥m denote the collection of 
all C^, C°° or C'" functions defined on open subsets of M, and call the 
system L of vector fields F^/ -Jinear if every combined vector field fK+gL 
belongs to L, whenever f,gE ¥m and K, L Eh. Here, fK+gL is defined 
in the intersection of the domains of definition of /, g, K and L. To study 
the problem, it is obviously no restriction to assume that L is FM-linear. 
For p E M arbitrary, define 

L(p) := {L{p) : L G L}. 

Since L is FA/-linear, this is a linear subspace of TpM. So Problem 1 .6 is to 
find submanifolds satisfying TpN D L(p), for every p E N. Notice that 
an appropriate answer should enable one to find all such submanifolds. 
Also, suppose that A^i and N2 are two solutions with A^2 C A"!. Then the 
problem with the pair (M, A^) is exactly the same as the problem with the 
pair (Ni, N2). Hence a better formulation. 

Problem 1.6'. Find all the submanifolds N C M of smallest dimension 
that satisfy TpN D IL(p), for every p E N. 



The classical Frobenius theorem (jFrMTl |SpT970} IBER1999[ IBol991[ 



IChl991[ IStk2000[ ITrvl992ll ) provides an answer in the (for us simplest) 
case where L is closed under Lie brackets and is of constant dimension: 
every point p E M admits an open neighborhood foliated by submanifolds 
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satisfying TqN = L(g), for every q e N. The global properties of 
these submanifolds were not much studied until C. Ehresmann and G. Reeb 
endeavoured to understand them (birth of foliation theory). A line with 
irrational slope in the 2-torus (M/Z)^ shows that it is necessary to admit 
submanifolds N of M which are not closed. Let Am denote the manifold 
structure of M. 

Definition 1.7. An immersed submanifold of (Af , Am) is a subset of N of 
M equipped with its own smooth manifold structure An, such that the in- 
clusion map i : {N, An) {M, Am) is smooth, immersive and injective. 

Thus, to keep maximally open Problem 1.6', one should seek immersed 
submanifolds and make no assumption about closedness under Lie brack- 
ets. For later use, recall that an immersed submanifold N of M is em- 
bedded if its own manifold structure coincides with the manifold inherited 
from the inclusion N C M. It is well known ( IICLN1985II ) that an im- 
mersed submanifold is embedded if and only if for every point p E N, 
there exists a neighborhood Up of p in M such that the pair (Up, N fl Up) 
is diffeomorphic to (W^"''^^, M^imAf^^ 

1.8. Maximal strong integral manifolds property. In order to under- 
stand Problem 1.6', for heuristic reasons, it will be clever to discuss the 
differences between the two possibilities h(p) = TpN and L(p) ^ TpN. 
Consider an arbitrary F7\/-linear system of vector fields L containing L, 
for instance L itself. Let p G M and define the linear subspace L(p) : = 
{L{p) : Let}. 

Definition 1.9. An immersed submanifold of M is said to be: 

• a strong h-integral manifold if TqN = L(g), at every point q E N; 

• a weak h-integral manifold if TqN D L(g), at every point q E N. 

In advance, the answer (Theorem 1.21 below) to Problem 1.6' states that 
it is possible to construct a unique system of vector fields L containing 
L, whose strong integral manifolds coincide with the smallest weak L- 
integral manifolds A^. Further definitions are needed. 

A system of vector fields L is said to have the strong integral manifolds 
property if for every point p E M, there exists a strong L-integral sub- 
manifold A^ passing through p. A maximal strong L,-integral manifold N 
is an immersed L-integral manifold with the property that every connected 
strong L-integral manifold which intersects A^ is an open submanifold of 
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A^. Thus, through a point p G M, there passes at most one maximal strong 
L-integral submanifold. Finally, the system L has the maximal strong in- 
tegral manifolds property if, through every point p E M, there passes a 
maximal strong L-integral manifold. The F^j-linear systems L containing 
L are ordered by inclusion. We then admit that Problem 1.6' is essentially 
reduced to: 

Problem 1.6". How to construct the (a posteriori unique) smallest (for 
inclusion) ¥m -linear system of vector fields L containing L which has the 
maximal strong integral manifolds property ? 

1.10. Taking account of the Lie brackets. Here is a basic geometric ob- 
servation inspired by Frobenius' and Nagano's theorems. 

Lemma 1.11. Assume the W^-Unear system L has the strong integral man- 
ifolds property. Then for every two vector fields L, L' Eh and for every p 
in the intersection of their domains, the Lie bracket [L, L'~\ (p) belongs to 

Up). 

Proof. Indeed, let be a strong L-integral manifold, namely satisfying 
TN = L|^. If L, L' G L, the two restrictions and are tangent to 
N. Hence the restriction to N of the Lie bracket [L, L'~\ is also tangent to 
A^. In conclusion, at every p E N,we have [L, L'] (p) E TpN = h{p). □ 

So it is a temptation to believe that the smallest system L^^'^ of vector 
fields containing L which is closed under Lie brackets does enjoy the 
maximal integral manifolds property. However, just after the statement 
of Nagano's theorem (Part II), we have already learnt by means of Exam- 
ple 1 .6(11) that in the and C " categories, the consideration of L^^'^ is 
inappropriate. 

1.12. Transport of a vector field by the flow of another vector field. 

To understand why L^^'^ is insufficient, it will be clever to recall one of 
the classical definitions of the Lie bracket between two vector fields. Let 
p E M and let K be a vector field defined in a neighborhood of p. Denote 
by K{q) the value of at a point q (this is a vector in TqM), by g*{K) 
the push-forward of i^' by a local diffeomorphism g, and hy q ^ Ks{q) 
[instead of q ^ exp(sA')(g)] the local diffeomorphism at time s induced 
by the flow of K. If L is a second vector field defined in a neighborhood 
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of p, the Lie bracket between K and L at pis defined by: 
(1.13) lK,L]i,p) := Ito - i'<ML(K-M)}-^ 

Observe that for every fixed s 7^ 0, the two vectors L{p) and 
(Ks)*(^(^'-s(p))) belong TpM. 




Definition of the system L'"^ and of the Lie bracket 



We explain how to read the right hand side of the diagram. In it: 
the integral curve of K passing through p is denoted by p; the inte- 
gral curve of L passing through the point K^s{p) for s very small is 
denoted by 7-s,l; its image by the local diffeomorphism is denoted 
by i^s(7-s,L); the vector L{K_s{p)) is tangent to 7-s,l at the point 
K^s{p)', the vector {Ks)*{L{K^sip))), transported by the differerential 
of Ks, is in general distinct from the vector L(p); in fact, the difference 
L{p) - {Ks)^{L{K_s{p))) divided by s, tends to [K, L]{p) as s ^ 0. 

Essentially, L'"^ collects all vector fields obtained by taking infini- 
tesimal differences (1.13) between vectors L(p) and transported vectors 
{Ks)*{L{K^sip))), and then iterating this processus to absorb all multiple 
Lie brackets. 

As suggested in the left hand side of the diagram, instead of taking the 
infinitesimal differences, it is more general to collect all the vectors of the 
form {Ks)*{L{p)). This is the clue of Sussmann's theorem. In fact, the 
system L which is sought for in Problem 1 .6" should not only contain L^"^, 
but should also collect all the vector fields of the form (Ks)*{L), where s 
is not an infinitesimal. 

Lemma 1.14. Let L, be a ¥M-linear system of vector fields containing L 
which has the strong integral manifolds property. Let p G M, let K,L Eh 
be two arbitrary vector fields defined in a neighborhood ofp and let q = 
Ks{p) be a point in the integral curve ofK issued from p, with s G M small. 
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Then the linear subspace L(g) necessarily contains the transported vector 
{KsULip))- 

Proof. Let iV be a strong L-integral manifold passing through p. As 
L(r) = TrN at every point r E N, and as L is contained in L, it fol- 
lows that the restricted vector field K\n is tangent to A^. Consequently, 
the integral curve of K issued from p is locally contained in N, hence the 
point q = Ks{p) belongs to N. 

Moreover, as L is contained in L, the vector L{p) is tangent to at p. 
The differential (A's)* being a linear isomorphism between TpN and TgN, 
it follows that the vector {Ks)^:{L{p)) belongs to the tangent space TgN, 
which coincides with L(g) by assumption. □ 

1.15. The smallest L-invariant system of vector fields L™^. Based on 
this crucial observation, we may introduce the smallest F^z-linear system 
of vector fields L™^ ("inv" abbreviates "invariant") containing L which 
contains all vectors of the form {Ks)*iL), whenever K, L Eh and s G M. 
It follows that (A;), (L"^^(p)) = L^"^^ {Ks{p)): the distribution of linear 
subspaces p i— > L™''(p) C TpM is invariant under the local flow maps. 

In ||Sul973L it is shown that L™^ is concretely and finitely generated 
as stated in Lemma 1.16 below. At first, some more notation is needed to 
denote the composition of several local diffeomorphisms of the form Ks- 
Let X denote the system of all tangent vector fields to M, defined on open 
subsets of M. Let A; e N with A; ^ 1 and let K = {K\ . . . , K^) E 
be a A;-tuple of vector fields defined in their domains of definition. If s = 
(si, . . . , Sfc) E M.'^ is a A;-tuple of "time" parameters, we will denote by 
Ks{p) the point 

K (■ ■ ■ iKiP)) ■■■)--=ew {s,K' (■ ■ ■ (exp(s,A''=(p))) ■■■)), 

whenever the composition is defined. The /c-tuple (si, . . . , s^) will also 
be called a multitime parameter. For s fixed, the map p Ks{p) is 
a local diffeomorphism between two open subsets of M. Its local in- 
verse is the map p i— ^ K-s{p), where K := {K'', . . . , K^) E L^' and 
? := (sfc, . . . , Si). Moreover, if we define (s, s') := (si, . . . , s^, s'^^, . . . , s'^,) 
for general s = (si, . . . , s^) E M*^ and s' = (s'^, . . . , s'^,) E M^', we have 
A'^,oi^, = (A'',A')(,,,3). 

After shrinking the domains of definition, the composition of local dif- 
feomorphisms A's is clearly associative, where it is defined. It follows that 
the set of local diffeomorphisms Ks constitutes a pseudogroup of local 
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diffeomorphisms. Here, the term "pseudo" stems from the fact that the do- 
mains of definitions have to be adjusted; not all compositions are allowed. 

Lemma 1.16. ( llSul973ll ) The system L™^ is generated by the ^M-Hnear 
combinations of all vector fields of the form {Ks)*{L), for all L G L, all 
k-tuples K = {K^, . . . , K'') G L'^ of elements of L and all multitime 
parameters s = (si, . . . , Sfc) G M^. 

The definitions and the above reasonings show that the Fj\/ -linear system 
L^'*^ is a subsystem of the F^z-linear system L^"^^ (of course, every system 
is contained in X): 

L C L^^" C L''^" C X . 

In general, at a fixed point p G M, the inclusions L(p) C L}^'^{p) C 
U^'^'ip) C X{p) = TpM may be all strict. 

Example 1.17. On M^, consider the system L generated by the three vector 
fields 

d d _^/^2 d 

Then it may be checked that 

' L(0)=Mc)xi, 

L>'^(0) =M9x, ©M^x,, 

L'°"(0) = M © M (9x2 © M 9x3, 

X(0) = M 9x1 © M 9x2 © M (9x3 © M 9x4- 

Theorem 1.18. dlNaigeeilSulTOll ) In the C^, andC'^''^ categories, the 
system L"^^ is the smallest one containing L that has the maximal strong 
integral manifolds property. In the category, L'°^ = L''®. 

Further structural properties remain to be explained. 

1.19. L-orbits. The maximal strong integral manifolds of U"" may be de- 
fined directly by means of L, without refering to L'"^, as follows. Two 
points g G M are said to be L-eguivaJent if there exists a local diffeo- 
morphism of the form K^, K = {K^, . . . , K''), s = (si, . . . , s^), G N, 
with Ksip) = Q- This clearly defines an equivalence relation on M. The 
equivalence classes are called the h-orbits of M and will be denoted either 
by or shortly by Cl, when the reference to one point of the orbit is 

superfluous. 

Concretely, two points p, g G M belong to the same L-orbit if and only if 
there exist a continuous curve 7 : [0, 1] ^ M with 7(0) = p and 7(1) = q 
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together with a partition of the interval [0, 1] by numbers = Sq < Si < 
S2 < ■ ■ ■ < Sfc = 1 and vector fields K^, . . . , K'' E L such that for each 
i = 1, . . . ,k, the restriction of 7 to the subinterval [sj_i, Sj] is an integral 
curve of K\ Such a curve will be called a piecewise integral curve of L. 

Let p E M. Then its L-orbit may be equipped with the finest 

topology which makes all the maps s t-^ Ks{p) continuous, for all A; ^ 1, 
all K = (K^, . . . , K'') E L*^ and all multitime parameters s = (si, . . . , Sfc). 
This topology is independent of the choice of a central point p inside a 
given orbit ( [|Sul973ll ). Since the maps R'' 3 s ^ Ks{p) e M are al- 
ready continuous, the topology of is always finer than the topology 
induced by the inclusion C M. It follows that the inclusion map 
from Oi^{p) into M is continuous. In particular, is Hausdorff. 

1.20. Precise statement of the orbit theorem. We now state in length 
the fundamental theorem of Sussmann, based on preliminary versions due 
to Hermann ( IIHel963ll ). to Nagano ( IINal966ll ) and to Lobry ( IILol970ll ). 
It describes L-orbits as immersed submanifolds (1), (2) enjoying the ev- 
erywhere accessibility conditions (3), (4), together with a local flow-box 
property (5), useful in applications. 

Theorem 1.21. (Sussmann [|Su1973[ ITrvl992[ IBM 19971 IBER1999[ 
IBCH20051 . [*]) The following five properties hold true. 

(1) Every "L-orbit Oi^, equipped with the finest topology which makes 
all the maps (p) continuous, admits a unique differentiable 
structure with the property that Oi^ is an immersed submanifold of 
M, of class C^, C°° or C^'". 

(2) With this topology, each L-orbit Cl is simultaneously a {con- 
nected) maximal weak integral manifold of L and a {connected) 
maximal strong integral manifold of the h-invariant ¥m -linear sys- 
tem L™^; thus, for every point p E M, it holds TpOi^{p) = L™^(p), 
whence in particular dimL™^(g) = dimOi^{p) is constant for all 
q belonging to a given L-orbit Oi^{p). 

(3) For every p E M, k ^ 1, K E h^, s E R'' such that Ks{p) 
is defined, the differential map (i^s)* makes a linear isomorphism 
fromTpOM = L""(p) onto Tk^^^PM = V^-{Ks{p)). 

(4) For every p,q E M belonging to the same "L-orbit, there ex- 
ists an integer k ^ 1, there exists a k-tuple of vector fields 
K = {K^,...,K'') E L'^ and there exists a multitime s* = 
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(s^, . . . , s^) G M'^ such that p = Ks*{q) and such that the differ- 
ential at s* of the map 

(1.22) R'^Bs^ Ks{q) G 

is of rank equal to dim Oi^{p). 

(5) For every p G M, there exists an open connected neighborhood Vp 
ofp in M and there exists a C^, C°° or C^'" diffeomorphism 

(1.23) X 3 (s, r) I — > ip{s, r) G Vp, 

where e = dimO]i{p), where □ = {x G M : |x| < 1}, such that: 

• ¥^(0,0)=^; 

• the plaque (D^ x {0}) is an open piece of the h-orbit ofp; 

• each plaque ip (D^ x {r}) is contained in a single h-orbit; 
and: 

• the set ofrE n^~^ such that ip(n'^ x {r}) is contained in the 
same h-orbit Oj^ (p) is either finite or countable. 

In general, for r ^ 0, the e-dimensional plaques (/'(□'^ x {r}) have 
positive codimension in the nearby orbits. We draw a diagram, in which 
e = dimOiL,(j>) = 1, with the nearby L-orbits O2, O^, C3 and having 
dimensions 2, 2, 3 and 3. 



Local orbit flow box theorem 



Property (4) is crucial: the maps (1.22) of rank dimOL(p) are used to 
define the differentiable structure on Oi^{p); they are also used to obtain 
the local orbit flow box property (5), as follows. 

Let p e M and choose q G with q ^ p,io fit with the diagrams 

(q = p would also do). Assuming that (4) holds, set e := dimOj^{p), 
introduce an open subset Tg in some e-dimensional affine subspace passing 
through s* in so that the restriction of the map (1 .23) to Tg still has rank 
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e at s 



Introduce also an 



n 



e) -dimensional local submanifold 



passing through p with TpAp © TpOi^{p) = TpM and set := K_s{^p). 
Notice that TgAg © TqOi^{p) = TgM, since the multiple flow map Ks{-) 
stabilizes Oi^{p). Then, as one of the possible maps whose existence is 
claimed in (5), we may choose a suitable restriction of: 



Te X A, 9 



s, r t- 




Local foliation by the multitime flow map 



1.24. Characterization of embedded L-orbits. A smooth manifold 
together with an immersion z : A^ ^ M is called weakly embedded if for 
every manifold P, every smooth map if) : P ^ M with V'(-P) C A^, then 
P —> A^ is in fact smooth ([[Spl970|; the diagram is also borrowed). 




An immersion of the real line in M? that is not weakly embedded 



Proposition 1.25. ( [|Bell996llBM1997llBCH2005ll ) Each h-orbit is count- 
able at infinity (second countable) and weakly embedded in M. 

As the multiple flows are diffeomorphisms, embeddability propagates. 

Proposition 1.26. ( [IBell996llBM1997[lBCH2005]l ) Let Cl be an h-orbit 
in M and let e := dim Cl. The following three conditions are equivalent: 

• Ol is an embedded submanifold of M; 

• for every point p G there exists a straightening map ip as 
in (1.23) with Cl n (D^ x D"-^) = (D^ x {0}); 

• there exists at least one point at which the preceding property 
holds. 
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Conversely, Cl is not embedded in M if and only if for every p G Cl 
and for every local straightening map (p centered at p as in (1.23), the set 
of r e □""'^ such that (p(D"-~^ x {r}) is contained in = C'l(p) is 
infinite {nonetheless countable). 

1.27. Local L-orbits and their smoothness. For U running in the collec- 
tion of all nonempty open connected subsets of M containing p, consider 
the localized L|c/-orbit of p in U, denoted by Oi^{U,p). If p E U2 C Ui, 
then Oi^{U2,p) C Oj^{Ui,p) (11/2, so the dimension of Oi^{U, p) decreases 
as U shrinks. Consequently, the localized L-orbit Oi^{U,p) stabilizes and 
defines a unique piece of locaj^ L-integral submanifold through p^, called 
the local L orbit ofpo and denoted by 0^{^^{p). In the CR context, this con- 
cept will be of interest in Parts V and VI. Sometimes, L-orbits (in M) are 
called global, to distinguish them and to emphasize their nonlocal, non- 
point wise nature. 

From the flow regularity Theorem 1.4 and from Theorem 1.21, it fol- 
lows: 

Lemma 1.28. Global and local "L-orbits are as smooth as L, i.e. C^, C°° 
or C'". Furthermore, 

T.Otip) C TMM,p) = L'-(p), 

for every p G M. This inclusion may be strict in the smooth categories 
and C'", whereas, in the category, local and global CR orbits have the 
same dimension. 

In the category, the maximal integral curve of an arbitrary ele- 
ment of L is C^+i trivially because the right hand sides of the equations 
dxki^)/dt = afc(x(t)), k = 1, ... ,n, are C'". May it be induced that 
general L-orbits are Trivially yes if dimL = 1 at every point. 

Another instance is as follows. Let r G N with 1 ^ r ^ n — 1 
and let L° = {L„}i^a<;j. be a system of C'" vector fields defined in 
a neighborhood of the origin in that are linearly independent there. 
Consider the system L generated by linear combinations of elements of 
L*^. Achieving Gaussian elimination and a linear change of coordinates, 
we may assume that r generators of L, still denoted by Li, . . . , L,., take 
the form = ^ + aij(x,y)^, i = l,...,r, with (x,y) = 

^ In certain references, local L-orbits are considered as germs. Knowing by experience 
that the language of germs becomes misleading when several quantifiers are involved in 
complex statements, we will always prefer to speak of local submanifolds of a certain 
small size. 
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(xi, . . . , x,., yi, . . . , Yn-r) and with aij{x, y) of class C^'" in a neighborhood 
of the origin. 

We claim that if Oi^{0) has (minimal possible) dimension r, then it is 
rpj^jg happens in particular if L is Frobenius-integrable. 

Indeed, the local graphed equations of Ol(0) must then be of the form 
Yj = hj{x),j = 1, . . . , 71 — r, with the hj of class at least C'", thanks to the 
lemma above. Observe that the Li are tangent to this submanifold if and 
only if the hj satisfy the complete system of partial differential equations 
-g^(x) = aij{x, h{x)), for z = 1, . . . , r, j = 1, . . . , ra - r, implying directly 
that the hj are C'^+^'^. In general, this argument shows that if dam.Oi^{p) 
coincides with dimL(p), the orbit is 0'^+^'°' at p. 

Example 1.29. However, this improvement of smoothness is untrue when 
dimL(p) + 1 ^ drnxOi^ij)) ^ n — 1. 

Indeed, pick the function Xn,a = X«;,a(z) of z G M equal to zero for 
z ^ and, for z ^ 0, defined by: 



This function is C^'" on M, but for (A,/9) > it is not C^'^ in 

any neighborhood of the origin. Then in M"^ equipped with coordinates 
(x, y, z, t), consider the hypersurface S of equation: 

= t - XK+i,Q(y) XK,a(z), 

Then S is C'", not better. The two vector fields Li := ^ and L2 : = 
I; + [xXK,a(-y)] ^ + [xUi,a(y) X^,a(z)] f havc C'''" coefficients and are 
tangent to S. We claim that S is the local {Li, L2}-orbit of the origin. 

Otherwise, there would exist a local two-dimensional submanifold 
{z = g{x,y), t = h{x,y)^ with Li and L2 tangent to it. Then 
[Li,L2] = XK,a(~y) ^ should also be tangent. However, at points 
(0, y, g{0, y), h{0, y)), with y negative and arbitrarily small, Li, L2 and L3 
are equal to the three linearly independent vectors and XK,ai—y) ^• 



§2. Finite type system and their genericity (openess and 



2.1. Systems of vector fields satisfying L^'" = L. Let M be a C (1 ^ k ^ 

00) connected manifold of dimension n ^ 1. By X, denote the system of 




if < a ^ 1, 



□ 



density) 
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all vector fields defined on open subsets of M (it is a sheaf). Let 



be di finite collection of C^^^ vector fields defined on M, namely La E 
X(M). Unlike in the category, in the C category, X(M) is always 
nonempty and quite large, thanks to partitions of unity. For this reason, 
we shall not work in the real analytic category, except in some specific 
local situations. The set of linear combinations of elements of L° with 
coefficients in ^^^(Af, M) will be denoted by L (or L^) and called the 
C-^MyiinearhuUofh^. 

Definition 2.2. A C~ ^(M) -linear system L c Xis said to be of finite type 
at a point p e M if L"'=(p) = TpM. 

If L^'® is of finite type at every point, then L''^ = L'"^ = X and there is 
just one maximal L-integral manifold in the sense of Sussmann: M itself. 

In 1939, Chow had already shown that the equality L'"^ = X implies the 
everywliere accessibility condition: every two points of M may be joined 
by integral curves of L. In 1967, Hormander established that every second 
order partial differential operator P := Lf + ■ ■ ■ + L'^ + Ri + Rq on a 
domain f2 C M" whose top order part is a sum of squares of C°° vector 
fields La, 1 ^ a ^ r, such that L^"^ = X is C°^-hypoelliptic, namely 
Pf G implies f e C^. Vector field systems satisfying L"'' = X 
have been further studied by workers in hypoelliptic partial differential 
equations and in nilpotent Lie algebras: Metivier, Stein, Mitchell, Stefan, 
Lobry and others. 

In the next Parts V and VI, we will focus on propagational aspects that 
are enjoyed by the (more general) smooth systems L that satisfy L'°^ = X, 
but possibly L^'^(p) ^ X(p) at every p E M. Nevertheless, for com- 
pleteness, we shall survey in the present section some classical geometric 
properties of finite type systems. 

2.3. Lie bracket flags, weights, privilegied coordinates and distance 
estimate. Define := L and by induction, for s G N with 2 ^ s ^ k, 
define to be the C^^'-Unear hull of L"-^ + [L\ L'-^]. Concretely, is 
generated over by iterated Lie brackets of length ^ s of the form: 



Jacobi's identity insures that [L''!, L^^] 

Denote L^(p) := Vectig {L{p) : L E L'^}. Clearly, L is of finite type at 
p G M if and only it there exists an integer d{p) ^ k with L^^^^^ (p) = TpM. 
The smallest d{p) is sometimes called the degree of non-holonomy of h at 



r > 1 




Lai] •••]]; 
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p. Other authors call it the type of L at p, which we will do. The function 

p t-^ d{p) e [1, k] U {00} is upper-semi-continuous: d{q) ^ d{p) for q 
near p. 

Combinatorially, at a finite type point, it is of interest to introduce the 
Lie bracket flag: 

{0} C l}{p) C L2(p) C ■ ■ ■ C L^(p) C ■ ■ ■ C l/^'P\p) = TpM. 

Then a finite type point p is called regular if the integers 7^s(g) : = 
dimL^(g) remain constant in some neighborhood of p. It is elementary to 
verify ( nBell996ll ) that, at such a regular point, the dimensions are strictly 
increasing: 

< ni{p) < n2{p) < ■ ■ ■ < nd(p){p) = n. 

¥ixp, not necessarily regular. A local coordinate system (xi, X2, . . . , x„) 
centered at p is linearly adapted at p if: 

L^(p)=Vect, (^,---,^), 

• • • ' a ' • • • ' a 1 ' 



L'^(p)(p) = Vectp 



d d d d 



r\ 

CXi OXni (p) OXn2 (p) ''^d(p) (p) 



Let us assign weights Wi to such linearly adapted coordinates Xj as fol- 
lows: the first group (xi, . . . , x„j(p)) being linked to L^(p), their weights 
will all be equal to one: wi = ■ ■ ■ = Wm{p) = I- The second group 
{xni{p)+i, • • • , Xn2{p)), linked to the quotient L^(p)/L^(p), will be assigned 
uniform weight two: Wn-^{p)+l = ■ ■ ■ = Wn2(p) = 2, and so on, until 
"^n,(rt-i(p)+i = ■ ■ ■ = w„^(,)(p) = d{p). 

Provided L is of finite type at every point, we claim that the original 
finite collection L° produces what is called a sub-Riemannian metric; then 
by means of weights, the topology associated to this metric may be com- 
pared to the manifold topology of M in a highly precise way. 

Indeed, let us define the (infinitesimal) sub-Riemannian length of a vec- 
tor Vp G L-'^(p) by: 

||t;p||LO := inf {{uj H hw^)^''^ : Vp = UiLi{p) ^ hMr-^r(p)}- 
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For Vp ^ L^(p), we set \\vp\\i^o = oo. The length of a piecewise curve 
7(t), t G [0, 1], will be the integral: 



Assume for instance d{p) = 2, so that n2{p) = n. If the coordinates 
are linearly adapted, the tangent space TpM then splits in the "horizontal" 
space, the (a:i, . . . , x„^(p)) -plane, together with a (not unique) "vertical" 
space generated e.g. by the remaining coordinates. It is then classical that 
the distance from p to a point of coordinates (xi, . . . , x„) close to p enjoys 
the estimate: 

dh<^{p, (xi, . . .,Xn)) X |xi| H h \xn,{p)\ + | a;„j (p)+i | H h |x„|^/^. 

Here, the abbreviation $ x means that there exists C > 1 with 
^ < $ < C \1'. Notice that the successive exponents coincide with 
the weights wi, . . . , Wni{p),Wn-i{p)+i, • • • , Wn. In particular, to reach a point 
of coordinates (0, . . . , 0, £, . . . , e), it is necessary to flow along L° during 
a time ~ est. e^^'^. Observe that |xi| + ■ ■ ■ + is equivalent to the dis- 
tance from p to X induced by any Riemannian metric. Thus, the modified 
distance dj^o is just obtained by replacing each \xi \ by up to a mul- 

tiplicative constant. 

To generalize such a quantitative comparison between the ciLO -distance 
and the underlying topology of M, linearly adapted coordinates appear 
to be insufficient. For P = (/3i, . . . , Pr) G N'', denote by the |/3|-th 
order derivation Lf^Lf^ ■ ■ ■ Lf.''. Beyond linearly adapted coordinates, one 
must introduce privileged coordinates, whose existence is assured by the 
following. 

Theorem 2.4. ( IIBell996ll ) There exist local coordinates ( 

tered at p that are privileged in the sense that each Xi is of order exactly 

equal to Wi with respect to iJ^ -derivations, namely, for i = 1, . . . ,n: 



Only if d{p) = 2, linearly adapted coordinates are automatically privi- 
leged ( BBel 19961 ). As soon as d{p) ^ 3, privileged systems are unavoid- 
able. 




Finally, the distance associated to the finite collection LP is: 

dLo{p,q):= inf lengthLo(7)- 



7: p^q 



L'^ Xi\p = 0, for all 7 with I7I ^ Wi — 1, 
L^^Xilp 7^ O5 for some f3* with \f3*\ = Wi. 
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Theorem 2.5. ( llBell996ll ) For x in a neighborhood ofp, the estimate: 

dj^oip, (xi, . . .,Xn)) X \x,\'/^-' + ■■■ + Ixnl'/""" 
holds if and only if the coordinates are privileged. 

For e > small, define the anisotropic ball Bi^o{p,e) := {x : 
di^o{p,x) < e}. 

Corollary 2.6. ( nBell996D There exist C > 1 such that 

^ n n 

i=l i=l 

2.7. Local basis. At a non-regular point, the integers nk{p), 
k = l,...,d{p) are not necessarily strictly increasing. Thus, it is 
necessary to express the combinatorics of the Lie bracket flag with more 
precision, in terms of what is sometimes called Hormander numbers nii, 
ii. From now on, we shall assume that the r vector fields La, 1 ^ a ^ r, 
are linearly independent at p and have C°° or coefficients. In both 
cases, the formal Taylor series of every coefficient exists. 
In the flag 

{0} C h\p) C iJ^ip) C ■ ■ • C h'{p) C • ■ ■ C h'^^P\p) = TpM. 

let nil denote the smallest A; ^ 2 such that the dimension of lJ^{p) is 
larger than the dimension of (p) (at a regular point, mi = 2) and set 
£i := dimL™^(j>)— r ^ \. Similarly, let m2 denote the smallest A; ^ 1+mi 
such that the dimension of \J^{p) is larger than the dimension of L'"^(p) 
(at a regular point, m2 = 3) and set £2 '■= dimL'"2(p) — dimL'"i(p). 
By induction, let rrij^i denote the smallest k ^ 1 + rrij such that the 
dimension of L^(p) is larger than the dimension of L"*^ (p) and set £-,+1 : = 
dimL™^+i(p) - dimL^^d?). 

Since p is a point of finite type, the process terminates until rrih = d{p) 
reaches the degree of non-holonomy at p, for a certain integer h ^ 1. We 
thus have extracted the interesting information, namely the strict flag of 
linear spaces: 

h\p) C L^Hp) C L'"2(p) C ■ ■ • C h""^{p) = TpM, 

with Lie bracket orders 1 < mi < 1112 < ■ ■ ■ < rrih, whose successive 
dimensions may be listed parallelly: 

r < r + £1 < r + £1 + £2 < ■ ■ ■ < + ^ £j- 
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Next, let ) be linearly adapted coordinates, vanish- 

ing at p. We shall denote them by {y, Si, S2, ■ ■ ■ , Sh), where y E W, 
Si E ]R^\ S2 E M^^, . . . , s/j E M^''. As in the preceding paragraph, we 
assign weight 1 to the y-coordinates, weight mi to the si-coordinates, 
weight 1712 to the S2-coordinates, . . . , weight uih to the s/i-coordinates. 
The weight of a monomial = sj^ s^^ ■ ■ ■ s]^ is obviously defined as 

+ mi I71I + m2 I72I H h |7h|- We say that a formal power series 

a{x) = a{y, si, . . . , Sh) is an 0(k) if all its monomials have weight ^ k. 
Also, a(x) is called weighted homogeneous of degree k if 

a {ty, r^si, r^ss, . . . , = t"a(|/, Si, S2, . . . , s/,), 

for all t G M. As in the case of M [2:1, ... , 2;„] with all weights equal to 1, 
every formal series a{y, si,S2, ■ ■ ■ , Sh) may be decomposed as a countable 
sum of weighted homogeneous polynomials of increasing degree. 

Dually, we also assign weights to all the basic vector fields: ^ will have 

weight —1, whereas for j = 1, . . . , rrih, the I = 1, . . . will have 
weight — mj. The weight of a monomial vector field ^ is defined to be 
the sum the weights of with the weight of Every vector field having 
formal power series coefficients may be decomposed as a countable sum 
of weighted homogeneous vector fields having polynomial coefficients. 

Theorem 2.8. ( IIBell996l IBER1999II ) Assume the local vector fields La, 
a = 1, . . . , r, have C°° or coefficients and are linearly independend at 
p. If the C°° or coordinates x = {y, Si, S2, ■ ■ ■ , Sh) centered at p are 
priveleged, then each La may be developed as: 

L„ = L„ + O(0), 

where each vector field: 

is homogeneous of degree —1 and has as its coefficients some polynomials 
Pa,j,i = Pa,j,i{y, "Si, ... , Sj„i) that are independent of Sj and are homoge- 
neous of degree rrij — 1. 

A crucial algebraic information is missing in this statement: what are the 
nondegeneracy conditions on the paj,i that insure that the system is indeed 
of finite type at p with the combinatorial invariants rrij and ij ? The real 
problem is to classify vector field systems that are of finite type, up to local 
changes of coordinates. At least, the following may be verified. 
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Theorem 2.9. ( IIBell996|lBER 199911 ) The vector fields La, a = 1, . . . ,r, 

form a finite type system ll* atp having the same combinatorial invariants 
rrij and ij and satisfying the same distance estimate as df^o in Theorem 2.5. 
Moreover, the linear hull o/L" generates a Lie algebra with the nilpo- 
tency property that all Lie brackets of length ^ rrih + 1 all vanish. 

2.10. Finite-typisation of smooth systems of vector fields. As previ- 
ously, let L° = {iva}i<;a^j. be a finite collection of vector fields 
globally defined on a connected manifold M of class C (1 ^ k ^ oo) 
and of dimension n ^ 1. Let L be its A/) -linear hull. If r = 1, 
then L''° = L, hence L cannot be of finite type, unless n = 1. So we 
assume n ^ 2 and r ^ 2. We want to perturb L slightly to L so as to 
get finite-typeness at every point: = TpM at every p E M. Since 

the composition of Lie brackets of length i requires coefficients of vector 
fields to be at least C^, if k < oo, then necessarily L^''' = L" stops at length 

K. 

At a central point, say the origin in K", and for K-analytic vector field 
systems, the already presented Theorem 1.1 1(11) yields small perturbations 
that are of finite type at 0. Of course, the same local result holds true for 
collections of vector fields that are C°°, or even with k large enough. 
Now, we want a global theorem. 

What does it mean for L to be close to L ? A vector field L E X(M) 
may be interpreted as a section of the tangent bundle, in particular a 
map M TM. The most useful topology on the set C^{M,N) of all 
maps from a manifold M to another manifold N (e.g. N = TM with 
A = K — 1) is the strong Whitney topology; it controls better than the so- 
called weak topology the behaviour of maps at infinity in the noncompact 
case. Essentially, f,gE C^{M, N) are (strongly) close to each other if all 
their partial derivatives of order ^ A, computed in a countable collection 
of charts ip^ : M" and : ^ M™ covering M and N,u eN, are 

Eu-close, the smallness of 5,^ > depending on the pair of charts {^pu, ipv)- 
Precise definitions may be found in the monograph nHil976ll . We then 
topologize this way the finite product X(Af)''. 

Already two vector fields may well be of finite type on a manifold of 
arbitrary dimension, e.g. and Ym=2 ^ 

Theorem 2.11. ( HLo 197011 ) If the connected manifold M of dimension n ^ 
2 is C"+"', then the set of pairs of vector fields L° := {K, L) E X(M)2 on 
M whose C" -linear hull L satisfies L" = L, is open and dense in 
the strong Whitney topology. 
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According to [|Sul976L the smoothness M e C"+"' in HLo 197011 was 
improved to M e C^" in Lobry's thesis (unpublished). We will summarize 
the demonstration in the case M G C^". However, since neither C^" nor 
(^n+n optimal, we will improve this result afterwards (Theorem 2.16 
below). 

Proof. Openness is no mystery. For denseness, we need some preliminary. 
If M and are two manifolds, we denote by J^(M, A^) the bundle of 
\-thjets of maps from M to N. We recall that, to a map f : M 
N is associated the A-th jet map j^f : M J^(M,N), a continuous 
map that may be considered as a kind of intrinsic collection of all partial 
derivatives of / up to order A. Let vr : J^{M,N) — > M be the canonical 
projection, sending a jet to its base point. For p G M, the fiber Ti^^{p) may 
be identified with M^"^".^ , where Nm,n,x '■= ^ ^^m' 'founts the number of 
partial derivatives of order ^ A of maps M" M"*. 

We will state a lemma which constitutes a special case of the jet trans ver- 
sality theorem. This particular statement (Lemma 2.12 below) generalizes 
the intuitively obvious statement that any C° curve graphed over M x {0}^ 
in M"^ may always be slightly perturbed to avoid a given fixed curve S. 

Call a subset S C J^{M, N) algebraic in the jet variables if in every 
pair of local charts, it possesses defining equations that are polynomials in 
the jet variables fj^a, 1 ^ j ^ m, a E N", |a| ^ A, whose coefficients are 
independent of the coordinates x G M. Of course, after a local diffeomor- 
phism X ^ x{x) of M, a general polynomial in the jet variables which is 
independent of x almost never remains independent of x in the new coor- 
dinates. Nevertheless, in the sequel, we shall only encounter special sets 
S C J^{M, N) which, in any coordinate system, may be defined as zero 
sets of such special polynomials. 

For instance, taking (xk,yj,yj,k) as coordinates on J^(M,N), where 
1 ^ k ^ n = dim M and 1 ^ j ^ m = dim A^, a change of coordinates 
X ^ x{x) induces {xk,yj,yj,k) i — ^ {xk,yj,yj,k), where yj = yj is un- 
changed but the new jet variables yj^k = Ym=i yj,i ^ involve the variables 
X (or x). Nevertheless, the equations {yj^k = 0, 1 ^ j ^ m, 1 ^ k ^ n} 
saying that the first (pure) jet vanishes are equivalent to {yj^k = 0, 1 ^ j ^ 
m, 1 ^ ^ n}, since the invertible Jacobian matrix (^) may be erased: 
vanishing properties in a jet bundle are intrinsic ! 

A theorem due to Whitney states that real algebraic sets are stratified, 
i.e. are finite unions of geometrically smooth real algebraic manifolds. 
The codimension of S is thus well-defined. 
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Lemma 2.12. ( [|Hil976ll ) Assume S C J^(M, A^) is algebraic in the jet 
variables and of codimension ^ 1 + dim M. Then the set of maps f G 
C^(M, A^) whose X-th prolongation j^f : M J^{M, N) does not meet 
S at any point is open and dense in the strong Whitney topology. 

Although j^/ is only continuous, the fact that the bad set S is algebraic 
enables to apply the appropriate version of Sard's theorem that is used in 
the jet transversality theorem. 

We shall apply the lemma by defining a certain bad set S which, if 
avoided, means that a pair of vector fields on M is of finite type at ev- 
ery point. 

Assume M e C^" and let {K,L) G X(M)2. Both vector fields have 
C^"-! coefficients. With \ := 2n - 1, denote by j2"-i(X(M)2) the fiber 
bundle of the (2n — l)-th jets of these pairs. In some coordinates provided 
by a local chart U 3 q {x^{q), . . . , G W, with U C M open, we 

may write K = Ei^t^n ^ii^) ^ and L = El^^^n Li{x) ^. In such a 
chart, the {2n - l)-th jet map f''-\K,L) : U — > .P''-^{X^{M)\u) is 
concretely given by: 

U3x^ (d^Ki{x), d^Li{x)) , , . 

We denote by Ki^a and Li a the corresponding jet variables. A C^" local 
diffeomorphism X i— > x = x{x) induces a triangular transformation involv- 
ing the chain rule between these jets variables, with coefficients depending 
on the 2?T,-th jet of x{x), some of which are only which might be un- 
pleasant. Fortunately, our bad set E will be shown to be algebraic with 
respect to the jet variables Ki^a and Lj q, in any system of coordinates. 

Let {K,L) G X(M)^. To write shortly iterated Lie brackets, we de- 
note ad{K)L := [K,L], so that ad(A')2L = [K,[K,L]], ad{KfL = 
[K, [K, [K, L]]] and so on. Also, we set ad^{K)L := L. Define a subset 
S C j2"-i(x2(M)) as a union S = S' U S" U S'", where: 

• firstly S' is defined by the 2n equations Ki Q = Lj o = 0; 

• secondly, S" is defined by requiring that all the nxn minors of the 
following n x (2n) matrix 

(ad°(ir)L ad\K)L ad^''-\K)L) , 

vanish; 

• thirdly, S'" is defined similarly, after exchanging K with L. 
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Lemma 2.13. In the vector space of real n x (2n) matrices, isomorphic to 
M^" , the subset of matrices of rank ^ {n — 1) is a real algebraic subset of 
codimension equal to (ra + 1). 

Without obtaining a complete explicit expression, it is easily verified 
that ad-'(A')(L), ^ j ^ 2?t, — 1, is a universal polynomial in the jet 
variables Ki a and Lj q. Under a local change of coordinates x ^ x{x), 
if the two vector fields K and L transform to K and to L (push-forward), 
all the multiple Lie brackets ad^ {K)L then transform to ad^ {K)L, thanks 
to the invariance of Lie brackets. Geometrically, the vanishing of each 
of the n X n minors defining S" and S'" means the linear dependence 
of a system of n vectors, thus it is an intrinsic condition. Consequently, 
although the jet variables Ki^a and Lj „ are transformed in an unpleasant 
way through diffeomorphisms, the sets S', S" and S'" may be defined by 
universal polynomials in the jet variables Ki ^ and Lj Q,, that are the same 
in any system of local coordinates. 

The lemma above and an inspection of a part of the complete expression 
of the ad\K){L), ^ j ^ 2n — 1 provides the following information. 
Details will be skipped. 

Lemma 2.14. The two subsets S" and S'" of J^""'^ {X{My) are both al- 
gebraic in the jet variables and of codimension {n + 1) outside S'. 

To conclude the proof of the theorem, we have to show that arbitrar- 
ily close to (A', L), there are pairs of finite type. Since S' has codimen- 
sion 2n > dimM, a first application of the avoidance Lemma 2.12 yields 
a perturbed pair, still denoted by (K, L), with the property that at every 
point p e M, either K{p) 7^ or L{p) ^ 0. Since S" and Yl" both 
have codimension n + 1 > dim M, a second application of the avoidance 
Lemma 2.12 yields a perturbed pair such that the two collections of 2n 
vector fields ad\K)L, ^ j ^ 2n - 1, and ad^(L)A', ^ j ^ 2n - 1, 
generate TM at every point p & M. The proof is complete. □ 

To improve this theorem, let r ^ 2 and consider the set X(M)'' of col- 
lections of r vector fields globally defined on M that are for some 
K ^ 2 to be chosen later. If L° = {Li, L2, . . . ,Lr}, is such a col- 
lection, its elements may be expressed in a local chart (xi, . . . ,Xn) as 
La = X]r=i V^a,i{x) for a = 1, . . . , r. Since the coefficients are C"^, 
it is possible to speak of L'^ only for X ^ k. We want to determine the 
smallest regularity k such that the set of r-tuples L° G X(M)'^ that are of 
finite type at every point of M is open and dense in X(A/)^' for the strong 
Whitney topology. 
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As in §1.8(11), let r\^,{r) denote the dimension of the subspace Fnir) 
of the free Lie algebra F(r) that is generated as a real vector space by 
simple words (abstract Lie brackets) of length ^ k. Then nf^(r) is the 
maximal possible dimension of L'*(p) at a point p E M. We know that L'' 
is generated by simple iterated Lie brackets of the form 

[Lai 5 [La2 ) • ■ ■ ) [La^-i, La^] ■■■]], 

for all A ^ fi: and for certain (not all) with 1 ^ ai, 02, . . . , oa-i? ax ^ r 
that depend on the choice of a Hall-Witt basis (Definition 1.9(11)) of Fi^{r). 

We choose k minimal so that r\^(r) ^ 2 dimM = 2n. This fixes 
the smoothness of M. For b = r + 1, . . . , r\f^(r), we order linearly as 
Lb = J2i=i '^b,i{x) the chosen collection of iterated Lie brackets that 
generate L". If A = A (6) denotes the length of Lh, namely Lt, G L'*''^'') of 
the form Lt = [La^, . . . , La^^^^J . . . ] , there are universal differ- 

ential polynomials ^a^, the (A(6) — l)-th jet of the coefficients ipa^i 

such that tpb,i{x) = ^ai,...,a;^(f,) (-'^'■^''~^V'(^)) • Also, in a fixed local system 
of coordinates, we form the n x (2n) matrix 

Similarly as in the proof of the previous theorem, we define a "bad" subset 
S of J''^^(X(Af)') by requiring that the dimension of L'^d?) is ^ (n — 1) 
at every point p G M. This geometric condition is intrinsic and neither 
depends on the choice of local coordinates nor on the choice of a Hall- Witt 
basis. Concretely, in a local system of coordinates, S is described as the 
zero-set of all n x n minors of the above matrix. Thanks to Lemma 2.13 and 
to an inspection of a portion of the explicit expressions of the jet polyno- 
mials ^aj^... a^^j^j (^Jx^'^^~^ (p{x)) , we may establish the following assertion. 

Lemma 2.15. The so defined subset S = { dimL'^(p) ^ — 1, G 
M} of J'^~^{'K{MY) is algebraic in the jet variables and of codimension 
{n + 1). 

Then an application of the avoidance Lemma 2.12 yields that, after an 
arbitrarily small perturbation of L°, still denoted by L°, we have L''(p) = 
TpM for every p G M. Equivalently, the type d{p) of p is finite at every 
point and satisfies d{p) ^ k. 

Theorem 2.16. Let r ^ 2 be an integer and assume that the connected 
n-dimensional abstract manifold M is where k is minimal with the 
property that the dimension nt^{r) of the vector subspace ^nir), of the free 
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Lie algebra F(r) having r generators, that is generated by all brackets of 
length ^ K, satisfies 

n«;(r) ^ 2dimM = 2n. 

Then the set of collections ofr vector fields L° G X(M)'" that are of type 
^ K at every point is open and dense in X(M)'' for the strong Whitney 
topology. 

A more general problem about finite-typisation of vector field structures 
is concerned with general substructures of a given finite type structure. 

Open question 2.17. Given a finite type collection = {Kb}i<^b^s, s ^ 
3, ofC^'^ vector fields on M of class C with the property that W^{p) = 
TpM at every point and given a C^'^ subsystemh^ = {La}i<a<r, 2 ^ r ^ 
s — 1, of the form La = J2i^b^s '^a,b Kf,, is it always possible to perturb 
slightly the functions ■il)a,b '■ M so as to render of finite type at 

every point ? If so, what is the smallest regularity k, in terms ofr, s and 
the highest type o/]K° at points ofM ? 

Finally, we mention a result similar to Theorem 2.16 that is valid in 
the category and does not use any Lie bracket. It is based on Suss- 
mann's orbit Theorem 1.21. The reference HSu 197611 deals with several 
other genericity properties, motivated by Control Theory. 

Theorem 2.18. ( llSul976l ) Aj'^timgr ^ 2andK ^ 2. The set of collections 
LP = {La}i^a^r of T vector ficlds on a connected manifold M so that 
M consists of a single h-orbit, is open and dense in X(Af)'' equipped with 
the strong Whitney C^"^ topology. 

2.19. Transition. The next Section 3 exposes the point of view of Analy- 
sis, where vector field systems are considered as partial differential opera- 
tors, until we come back to the applications of the notion of orbits to CR 
geometry in Section 4. 

§3. Locally integrable CR structures 

3.1. Local insolvability of partial differential equations. Until the 
1950's, among analysts, it was believed and expected that all linear par- 
tial differential equations having smooth coefficients had local solutions 
( [|Trv2000ll '). In fact, elliptic, parabolic, hyperbolic and constant coeffi- 
cient equations were known to be locally solvable. Although his thesis 
subject was to confirm this expectation in full generality, in 1957, Hans 
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Lewy ( ULew 195711 ) exhibited a striking and now classical counterexam- 
ple of a C°° function g in a neighborhood of the origin of M.^, such that 
Lf = g has no local solution at all. Here, L = + is the gen- 
erator of the Cauchy-Riemann anti-holomorphic bundle tangential to the 
Heisenberg sphere of equation v = zz in C^, equipped with coordinates 
{z, w) = {x + iy, u + iv). 

From the side of Analysis, almost absent in the two grounding 
works nPo 190711 and nCal932|| of Henri Poincare and of Elie Cartan, 
Lewy's discovery constituted the birth of smooth linear PDE theory 
and of smoooth Cauchy-Riemann geometry. Later, in 1971, the simpler 
two-variables Mizohata equation |^ — ix^ % — 9 shown by Grushin 
to be non- solvable, if k is odd, for certain g. One may verify that the set of 
smooth functions g for which Lewy's or Grushin's equation is insolvable, 
even in the distributional sense, is generic in the sense of Baire. For k = 1, 
the Mizohata vector field — ix 4- intermixes the holomorphic and 

ax ay ^ 

antiholomorphic structures, depending on the sign of x. 

In 1973 answering a question of Lewy, Nirenberg ( llNil973ll ') exhibited 
a perturbation ^ — i x(l + y)) ^ of the Mizohata vector field, where 
if is C°° and null for x ^ 0, such that the only local solutions of L/ = 
are the constants. A year later, in UNi 19741 . he exhibited a perturbation 
of the Lewy vector field having the same property. A refined version is as 
follows. 



Let be a domain in M?, exhausted by a countable family of compact 
sets Kj, J = 1,2,... with Jij C Int Kj+i. If / G C°°(fi, C), define 
the Frechet semi-norms Pj{f) := max^.g/^^ |q,|<;j \d^f{x)\ and topologize 

C°°(1],C) by means of the metric d{f,g) := ^JL^ i+pi7-g) - Consider 



equipped with this topology for each coefficient aj. 

Theorem 3.2. ( IIJT1982llJaT990]l ) The set of L e Z for which the solutions 
u G C^iyi, C) ofLu = are the constants only, is dense in L. 

These phenomena and others were not suspected at the time of Lie, of 
Poincare, of E. Cartan, of Vessiot and of Janet, when PDE theory was 
focused on the algebraic complexity of systems of differential equations 
having analytic coefficients. In 1959, Hormander explained the behavior of 
the Lewy counter-example, as follows. The references BTrv 1 970[ ITrv 1 9 8 6l 



the set 
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lES 19931 ITrv2000ll provide further survey informations about operators of 
principal type, operators with multiple characteristics, pseudodifferential 
operators, hypoelliptic operators, microlocal analysis, etc. 

Let P = P(x,(9^) = EaGN",|aKm 0^ bc a linear partial dif- 
ferential operator of degree m having C°° complex-valued coefficients 
tta : f2 ^ C defined in a domain C M". Its symbol P{x,^) : = 
'^\a\<m '^a{x) (^0" ^ function from the cotangent T*^l = Q x MJ^ 
to C. Its principal symbol is the homogeneous degree m part Pm{x,^) : = 
E|a|=m (^0"- The cone of points e x (M"\{0}) such that 

-Pm(a^) = is the characteristic set of P, the locus of the obstructions to 
existence as well as to regularity of solutions / of P{x, d^)/ = g. 

The real characteristics of P are called simple if, at every character- 
istic point (xo,^o) with 7^ 0, the differential d^P^ = Y^k=i 
with respect to ^ is nonzero. It follows from homogeneity and from Eu- 
ler's identity that the zeros of P are simple, so the characteristic set is a 
regular hypersurface of ^2 x (M"\{0}). One can show that this assump- 
tion entails that the behaviour of P is the same as that of Pm- in a certain 
rigorous sense, lower order terms may be neglected. In his thesis (1955), 
Hormander called such operators of principal type, a label that has stuck 
( iTrvl970| ). 

Call P solvable at a point xq G if there exists a neighborhood U of xq 
such that for every g E C°^{U), there exists a distribution / supported in U 
that satisfies Pf = g inU. In 1955, Hormander had shown that a principal 
type partial differential operator P is locally solvable if all the coefficients 
aa{x), \a\ = m, of its principal part Pm are real-valued. On the contrary, 
if they are complex- valued, in 1959, he showed: 

Theorem 3.3. ( l|Hol963l| ) If the quantity 

^ d^k dxk 

is nonzero at a characteristic point (xq, ^o) ^ T*Vt, for some 7^ 0, then 
P is insolvable at Xq. 

With Pm{x, d^) := E|a|=m «"(^) "^x ' denote by C2m-i{x, the prin- 
cipal symbol of the commutator \Pm{x,dx), Pm{x,dx)\, obviously zero 
if Pm has real coefficients. The above necessary condition for local solv- 
ability may be rephrased as: if P is locally solvable at xq, then for all 

^ G M"\{0}: 

P^(x,0 =0 =^ C2™„i(x,0 = 0. 
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This condition explained the non-solvability of the Lewy operator appro- 
priately. 

3.4. Condition (P) of Nirenberg-Treves and local solvability. The geo- 
metric content of the above necessary condition was explored and general- 
ized by Nirenberg-Treves ( IINT1963[ |NT1970[ fTrvWM ). Recall that the 
HamiJtonian vector /ieJd associated to a function / = f{x,^) E C^{QxW) 



It follows at once that the function ^) must be constant along its 
bicharacteri sties. When the constant is zero, a bicharacteristic is called 
a null bicharacteristic. In particular, null bicharacteri sties are contained in 
the characteristic set, which explains the terminology. 

Then Hormander's necessary condition may be interpreted as follows. 
Let B(x, ^) be the imaginary part of Pm{x, An immediate computation 
shows that the principal symbol of [A{x, d^), B{x, dx)] is given by: 



Theorem 3.3 says that the nonvanishing of Ci at a characteristic point en- 
tails insolvability. In fact, Nirenberg-Treves observed that if the order of 
vanishing of B along the null characteristic of A is odd then insolvability 
holds. Beyond finite order of vanishing, what appeared to matter is only 
the change of sign. Since the equation Pf = g has the same solvability 
properties as z Pf = g, for all z G C\{0}, this led to the following: 

Definition 3.5. C UNT 19631 INT 197011 ') A differential operator P of prin- 
cipal type is said to satisfy condition (P) if, for every z G C\{0}, the 
function Im {z Pm) does not change sign along the null bicharacteristic of 

The next theorem has been shown for P having coefficients and in 
certain cases for P having C°° coefficients by Nirenberg-Treves, and fi- 
nally, in the general category by Beals-Fefferman (sufficiency) and by 
Moyer (necessity). 





Equivalently, 



Ci(x,0 = {dB/dt) (x,0. 



78 



JOEL MERKER AND EGMONT PORTEN 



Theorem 3.6. ( [INT1963[ ITrv 19701 INT1970[ IBeFel973[ ITrvl986ll ) Con- 
dition (P) is necessary and sufficient for the local solvability in LP' of a 
principal type linear partial differential equation Pf = g. 

Except for complex and strongly pseudoconvex structures, little is 
known about solvability of systems of PDE's, especially overdeter- 
mined ones ( IITrv2000ll '). In the sequel, only vector field systems (order 
m = 1), studied for themselves, will be considered. 

3.7. Involutive and CR structures. Following [|Trvl981l ITrvl992[ 
IBCH2005H . let M be a C", C°° or C^'" (k ^ 2, < a < 1) paracom- 
pact Hausdorff second countable abstract real manifold of dimension 
/i ^ 1 and let £ be a C^, or C""^ " complex vector subbundle of 
CTM := C (g) TM of rank A, with 1 ^ A ^ Denote by Cp its fiber at 
a point p E M. Denote by T the orthogonal of C for the duality between 
differential forms and vector fields. It is a vector subbundle of CT*M, 
whose fiber at a point p e M is = [to G CT*M : w = on Cp]. 
The characteristic setC := T CiT* M (real T*M) is in general not a vector 
bundle: the dimension of may vary with p, as shown for instance by the 
bundle generated over by the Mizohata operator dx — ix dy. 

From now on, we shall assume that the bundle C is formally integrable, 
i.e. that [C,C] C jC. Then C defines: 

• an elliptic structure if Cp = for all p E M; 

• a complex structure of Cp® Cp = CTpM for all p E M; 

• a Cauchy-Riemann (CR for short) structure if Cp D Cp = {0} for 

all pE M; 

• an essentially real structure if Cp = Cp, for all p E M. 

In general, C will be called an involutive structure if [C, C] = C. 
Let us summarize basic linear algebra properties ( [|Trvl98U ITrvl992[ 
IBCH20051 '). Every essentially real structure is locally generated by real 
vector fields. Every complex structure is elliptic. If £ is a CR structure 
(often called abstract), the characteristic set C is in fact a vector subbundle 
of T*M of rank /i — 2 A; this integer is the codimension of the CR structure. 
A CR structure is of hypersurface type if its codimension equals 1. 

3.8. Local integrability and generic submanifolds of C". The bundle 
C is locally integrable if every p E M has a neighborhood Up in which 
there exist r := fi — X functions zi, . . . , Zr : Up C of class C^, C°° 
or C'" whose differentials dzi, . . . , dzr are linearly independent and span 
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T|[/p (or equivalently, are annihilated by sections of C). In other words, the 
homogeneous PDE system Cf = has the best possible space of solutions. 

Here is a canonical example of locally integrable structure. Consider a 
generic submanifold M of C" of class C^, C°° or C''^, k ^ 1, ^ a < 1, 
as defined in §2.1(11) and in §4.1 below. Let c? ^ be its codimension and 
let m = n - ^ be its CR dimension. Let T'^M = TM n JTM (a 
real vector bundle) and let CTM = C ® TM. Define the two complex 
subbundles T^'^M and T^'^M = T^'^M of CTM whose fibers at a point 
p E M are: 

Tpi'°M = {Xp + iJXp : Xp e T;M} = {Zp G CTpM : JZp = -iZp}, 
T^^^M = {Xp - iJXp : Xp e T^M] = {Zp G CTpM : JZp = iZp\. 

Geometrically, T^'°M and T°'^M are just the traces on M of the holomor- 
phic and anti-holomorphic bundles T^'°C" and T°'^C", whose fibers at a 
point 'p are X]fc=i '^k \ and Xlfc=i ^fc af~ | • They satisfy the Frobenius 
involutivity conditions '[T^'OM, T^'OM] C T^'^M and \r^^^M, T^^'^M\ C 
T°'^M. More detailed background information may be found in [|Chl991[ 
IBol991[riYvT992llBER1999l . 

On such an embedded generic submanifold Af, choose as structure bun- 
dle L just T^'^M C CTM. Then clearly, the n holomorphic coordinate 
functions zi, . . . , Zn are annihilated by the anti-holomorphic local sections 
X]fe=i gf^ of T^'^M and they have linearly independent differential, at 
every point of M. A generic submanifold embedded in C" carries a locally 
integrable involutive structure. Conversely: 

Lemma 3.9. Every locally integrable CR structure is locally realizable as 
the anti-holomorphic structure induced on a generic submanifold embed- 
ded C". 

Proof. Indeed, if a real //-dimensional C^, C°° or C'" manifold M bears 
a locally integrable CR structure, the map Z = (zi, . . . , Zr) produces an 
embedding of the open set Up as a local generic submanifold M := Z{Up) 
of C^ with Z^{C) = T^'^M. □ 

A locally integrable CR structure is sometimes called locally realizable 
or locally embeddable. 

3.10. Levi form. Let C be an involutive structure, not necessarily locally 
integrable and let Cj, G Cp C T^M be a nonzero characteristic covector at 
p. 



80 



JOEL MERKER AND EGMONT PORTEN 



Definition 3.11. The Levi form atp in the characteristic codirection Cp E 
Cp\{0} C T*M\{0} is the Hermitian fomi acting on two vectors Xp,Yp e 
C{p) as: 

-Cp.cp {Xp, Yp) := — Cp ( [X, F] ) , 

where X, Y are any two sections of C defined in a neighborhood of p and 
satisfying X{p) = Xp, Y{p) = Yp. The resulting number is independent 
of the choice of such extensions X, Y. 

For the study of realizability of CR structures of codimension one, non- 
degeneracy of the Levi form, especially positivity or negativity, is of cru- 
cial importance. An abstract CR structure of hypersurface type whose Levi 
form has a definite signe is said to be strongly pseudoconvex, since, after 
a possible rescaling of sign of a nonzero characteristic covector, all the 
eigenvalues of its Levi form are positive. 

3.12. Nonembeddable CR structures. After Lewy's discovery, the first 
example of a smooth strictly pseudoconvex CR structure in real dimension 
3 which is not locally embeddable was produced by Nirenberg in 1973 
( [|Nil973ll ), cf. Theorem 3.3 above. For CR structures of hypersurface 
type, Nirenberg 's work has been generalized in higher dimension under the 
assumption that the Levi form is neither positive nor negative, in any char- 
acteristic codirection. Let n ^ 2 and let ei = 1, Ek = —2, k = 2, . . . ,n. 

Theorem 3.13. ( I1JT1982[|BCH2005II ) There exists a C°° complex-valued 
function g = g{x, y, s) defined in a neighborhood of the origin in C" x M 
and vanishing to infinite order along {xi = yi = 0} such that the vector 
fields: 

are pairwise commuting and such that every solution h ofLjh = 0, j = 
1, 2, . . . , n defined in a neighborhood of the origin must satisfy §7(0) = 0. 

This entails that the involutive structure spanned by the Lj is not lo- 
cally integrable at 0. One may establish that the set of such g is generic. 
Crucially, the Levi-form is of signature (n — 1). 

Open problem 3.14. Find versions of generic non-embeddability for CR 
structures of codimension 1 having degenerate Levi-form. Find higher 
codimensional versions of generic non-embeddability. 
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3.15. Integrability of complex structures and embeddability of 
strongly pseudoconvex CR structures. Let us now expose positive 
results. Every formally integrable essentially real structure L = Re £ is 
locally integrable, thanks to Frobenius' theorem; however the condition 
[£, C] C C entails the involutivity of Re£ only in this special case. Also, 
every analytic formally integrable CR structure is locally integrable: it 
suffices to complexify the coefficients of a generating set of vector fields 
and to apply the holomorphic version of Frobenius' theorem. For complex 
structure, the proof is due to Libermann (1950) and to Eckman-Frolicher 
(1951), see [|AH1972a[|Trvl981[riYvT99a . 

Theorem 3.16. Smooth complex structures are locally integrable. 

This deeper fact has a long history, which we shall review concisely. On 
real analytic surfaces, isothermal coordinates where discovered by Gauss 
in 1825-26, before he published his Disquisitiones generales circa superfi- 
cies curvas. In the 1910's, by a nontrivial advance, Kom and Lichtenstein 
transferred this theorem to Holder continuous metrics. 

Theorem 3.17. Letds^ = E + 2 F dudv+G dv^ be aC^''' (0 < a < 1) 
Gaussian metric defined in some neighborhood of in M^. Then there 
exists a C^'" change of coordinates {u, v) ^ (tt, v) fixing and a C°'" 
function A = A(n, v) such that: 

X {du^ + dv^) = Edu^ + 2F dudv + G dv"^. 

A modem proof of this theorem based on the complex notation and 
on the d formalism was provided by Bers ( [|Bel957 ll) and by Chern 
( IIChl955ll ). In the monograph HVe 196211 , deeper weakenings of smooth- 
ness assumptions are provided. 

As a consequence of this theorem, complex structures of class C°'" on 
surfaces may be shown to be locally integrable. Let us explain in length 
this corollary. 

At first, remind that an almost complex structure on 2n-dimensional 
manifold M is a smoothly varying field J = (Jpjp^M of endomorphisms 
of TpM satisfying JpO Jp = —Id. Thanks to J, as in the standard complex 
case, one may define T^^^M := {Xp + iJpXp : Xp G TpM} and then the 
bundle C := T°'^M is a complex structure in the PDE sense of §3.7 above. 
Conversely, given a complex structure C C CTM, then locally in some 
neighborhood Up of an arbitrary point p E M, there exist local coordinates 
(xi, . . . , x„, 2/1, . . . , Hn) vanishing at p so that n complex vector fields of 
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the form: 

n n 

Zj ttkj d^^+i^ bk,j dy^, 

k=l k=l 

with afc,j(0) = 5k,j = bkj{0), span C\up- The associated almost complex 
structure is obtained by declaring that, at a point of coordinates (x, y ), one 
has: 

(n \ n / " \ 

^^^^ J = ^^'i ( S ^^'^ ^yA=-Y^ d^^. 

k=l ) k=l \k=l ) k=\ 

Lemma 3.18. The bundle C C CTM satisfies [C,C] C C if and only if, 
for every two vector fields X and Y on M, the Nijenhuis expression: 

N{X,Y) := [JX,JY] -J[X,JY] -J[JX,Y] - [X,Y] 

vanishes identically. 

The proof is abstract nonsense. Also, one verifies that N(f X,gY) = 
f g N(X, Y) for every two smooth local function / and g: the expression 
N is of tensorial character. In symplectic and in almost complex geometry 
( IIMS1995II ). the following is settled. 

Definition 3.19. The almost complex structure is called integrable if, in 
some neighborhood Up of every point p E M there exist n complex- valued 
functions zi, . . . , Zn : Up — > C of class at least and having linearly 
independent differentials such that dzk o J = i o dzk, for k = 1, . . . ,n. 

One verifies that it is equivalent to require Czk = 0, k = 1, . . . ,n: inte- 
grability of an almost complex structure coincides with local integrability 

ofC = rO'^M. 

Now, we may come back to the integrability Theorem 3.16. To an arbi- 
trary Gaussian metric g = ds^ as in Theorem 3.17, with > 0, G > and 
EG — > 0, are associated both a volume form and an almost complex 
structure: 

dvolg := a/ eg — F"^ du A dv and J„ := = 
' ' VEG - F2 

Conversely, given a volume form and an almost complex structure J on a 
surface, an associated Riemannian metric is provided by: 

gi-, ■) := dvo\{-, J-). 

According to Kom's and Lichtenstein's theorem, there exist coordinates 
in which the metric is conformally flat, equal to A {dv? + dv"^). In these 
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coordinates, the associated complex structure is obviously the standard 
one: Jdu = and Jd^ = —du- In fact, any local change of coordi- 
nates (m, v) I— s> {u, v) which respects orthogonality of the curvilinear co- 
ordinates, i.e. transforms the Gaussian isothermal metric to a similar one 
A (du"^ + dv'^), commutes with J, so that the map u + iv i— > u + iv is 
holomorphic. In conclusion: 

Theorem 3.20. C*^'" (0 < a < 1) complex structures are locally inte- 
grable. 

The generalization to several variables of the theorem of Kom and Licht- 
enstein is due to Newlander-Nirenberg, who solved a question raised by 
Chem. The proof was modified and the smoothness assumption was per- 
fected by several mathematicians: Nijenhuis-Woolf ( nNW1963l ), Mal- 
grange, Kohn, Hormander, Nirenberg, Treves ( UTrv 199211 ) and finally Web- 
ster ( IIWel989cll ) who used the Leray-Koppelman d homotopy formula to- 
gether with the Nash-Moser rapidly convergent iteration scheme for solv- 
ing nonlinear functional equations. 

Theorem 3.21. (C^'^ '", < a < 1: [INN1957II : C^-", < a < 1: 
^NW196^3llWel989cll : C°°: llTrvl992ll ) Suppose that on the real manifold 
M of dimension 2n ^ 4, the formally integrable complex structure C is 
C°° or C"^'", K ^ 2, < a < 1. Then there exist local complex-valued 
coordinates {zi, . . . , z„) annihilated by C which are C°° or C'". 

Finally, an elementary linear algebra argument ( nTrvl981[ |Trvl992[ 
IBCH2005H ) enables to deduce local integrability of C°° or C"""^ " ellip- 
tic structures from the above theorem. In fact, elliptic structures are shown 
to be locally isomorphic to x M'*'"'^, equipped with 

Problem 3.22. Is a formally integrable involutive structure having 
positive-dimensional characteristic set locally integrable ? 

Again the history is rich. Integrability results are known only for 
strongly pseudoconvex CR structures of hypersurface type. Solving a ques- 
tion raised by Kohn in 1965, Kuranishi ( IIKul982ll ) showed in 1982 that 
strongly pseudoconvex abstract CR structures of dimension ^ 9 are locally 
realizable. His delicate proof involved a study of the Neumann operator in 
spaces, for solving the tangential Cauchy-Riemann equations, together 
with the Nash-Moser argument. In 1987, Akahori ( ||Akl987ll ) modified the 
technique of Kuranishi and included the case of dimension 7. 
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In 1989, to solve an associated linearized problem, instead of the Neu- 
mann operator, Webster used the totally explicit integral operators of 
Henkin. 

Theorem 3.23. ( [IWel989a[rWel989bll ) Let M be a strongly pseudoconvex 
{2n—l)- dimensional CR manifold of class C^. Then M admit, locally near 
each point, a holomorphic embedding of class provided 

n ^ 4, K ^ 21, /i^6K + 5n — 3. 

The main new ingredient in his proof was Henkin' local homotopy op- 
erator Om on a hypersurface M C C": 

/ = dM P{f) + Q(dM /), /a (0, 1) - form, 

known to hold for n ^ 4. For this reason, Webster suspected the exis- 
tence of refinements based on an insider knowledge of d techniques. In 
1994, using a modified homotopy formula yielding better C-estimates, 
Ma-Michel HMM 199411 improved smoothness: 

K ^ 18, /i^K + lS. 

Up to now, the five dimensional remains open. In fact, the solvability of 
dn f = for a (0, l)-form on a hypersurface of C'^ requires a special 
trick which does not lead to a homotopy formula. Nagel-Rosay IINR1989II 
showed the nonexistence of a homotopy formula in the 5-dimensional case, 
emphasizing an obstacle. 

Open problem 3.24. Find generalizations of the Kuranishi-Akahori- 
Webster-Ma-Michel theorem to higher codimension, using the integral for- 
mulas for solving the Bm due to Ayrapetian-Henkin. Replace the assump- 
tion of strong pseudoconvexity by finer nondegeneracy conditions, e.g. 
weak pseudoconvexity and finite type in the sense ofKohn. 

3.25. Local generators of locally integrable structures. Abandoning 
these deep problems of local solvability and of local realizability, let us 
survey basic properties of locally integrable structures. Thus, let £ be a 
C°° or C^"^'" locally integrable structure of rank A on a C'" or C°° mani- 
fold M of dimension ji. Denote by r = yU — A the dimension of T = 
Let p e M and let 5p denote the dimension of Cp = T n T*M. Notice that 
(r — 5p) + (r — 5p) + (5p + (A — r + = r + A = /i just below. 

Theorem 3.26. ( IITrvl981[ lTrvl992l lBCH2005ll ) There exist real coordi- 
nates: 
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defined in a neighborhood Up ofp and vanishing at p, and there exist 
or C'^'°' functions ^pj = (pj{x,y,u, s) with ipj{0) = 0, dipj{0) = 0, j - 
1, . . . ,6p, such that the dijferentials of the t functions: 



Zk := Xk + iyk, 



k = 1 T — 6, 



Wj := Uj + i (Pj{x, y, u, s) 



pi 

j = l,...,Sp 



span T 



Ur,- 



Since dipj{0) = 0, there exist unique coefficients bij = bij{x,y,u, s) 
such that the vector fields: 



d 



1=1 



k — 1, . . . , 6p, 



satisfy Kj^{wj^) 
fields: 



for ji, j2 = 1, • • • , ^p- Define then the A vector 



- d dip, 
dzk dzk 



k = l. 



1=1 ^ 



J = l,...,\-r + 5p 



Clearly, = Lk^{zk^) = Lk{wj) = L'-{zk) = L'-^{wj^), hence the structure 
bundle C\u^ is spanned by th e L^, L'-. O ne may verify the commutation 
relations ( llTrvl981[ITHn^lBCH2005]| ): 

0= = [L;.^,i^,,] = [%,i^,,]. 

Remind that if an involutive structure C is CR, then 5p is independent of 
p and equal to the codimension ji — 2\=:5.\i follows that t — 5 = r — fi + 
2X = X, or \ — T + S = 0: this means that the variables (si, . . . , sx^r+Sp) 
disappear. 

Corollary 3.27. In the case of a CR structure of codimension 6, the local 
integrals are: 

Zk:=Xk + iyk, k = l,...,X, 
Wj := Uj + i(pj{x,y,u), j = 1,...,6, 



86 



JOEL MERKER AND EGMONT PORTEN 



and a local basis for the structure bundle C\up is: 

Lk := ^ - iy^^ Ki, k=l,...,X. 

We recover a generic submanifold embedded in which is graphed by 
the equations Vj = ^Pj{x, y, u), as in Theorem 2.3(11), or as in Theorem 4.2 
below. 

3.28. Local embedding into a CR structure. But in general, the coor- 
dinates (si, . . . , sx-r+5p) are present. A trick ( BMa 19921 ) is to introduce 
extra coordinates (ti, . . . ,tA-r+<5p) and to define a new structure on the 
product Up X ]R'^~^+'^p generated by the following local integrals: 

5fc •= ^/c! = 1, . . . , r — (5p, 

Zk '■= Sk-T+Sp + i tk-T+5p, k = T - 6p + 1, . . . ,X, 
Wj:=Wj, j = l,...,6p. 

The associated structure bundle C is spanned by: 

{Lk '■= Lk, k = l,...,r — 5p, 

It is a CR structure of codimension 5p on Up x ]R'^"'^+'^p. All analytico- 
geometric objects defined in Up can be lifted to Up x M'^~'^+''p, just by 
declaring them to be independent of the extra variables (ti, . . . , tx-r+Sp)- 

Such an embedding enables one to transfer elementarily several theo- 
rems valid in embedded Cauchy-Riemann Geometry, to the more general 
setting of locally integrable structures. For instance, this is true of most 
of the theorems about holomorphic or CR extension of CR functions pre- 
sented Part V. In addition, most of the results stated in §3, §4 and §5 below 
hold in locally integrable structures. 

3.29. Transition. However, for reasons of space and because the possi- 
ble generalizations which we could state by applying this embedding trick 
would require dry technical details, we will content ourselves to just men- 
tion these virtual generalizations, as was done in [MP 1 9991 . For fur- 
ther study of locally integrable structures, we refer mainly to [|Trvl992[ 
IBCH2005ll and to the references therein. 

In summary, in this Section 3, we wanted to show how our approach is 
inserted into a broad architecture of questions about solvability of partial 
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differential equations, about the problem of realizability of abstract CR 
structures, as well as into hypo-analytic structures. Thus, even if some of 
the subsequent surveyed results {exempli gratia: the celebrated Baouendi- 
Treves approximation Theorem 5.2) were originally stated in the context 
of locally integrable structures, even though we could as well state them in 
this context or at least in the context of locally embeddable CR structures 
(as was done in I1MP1999II ), we shall content ourselves to state them in the 
context of embedded Cauchy-Riemann geometry, just because the very 
core of the present memoir is concerned by Several Complex Variables 
topics: analytic discs, envelopes of holomorphy, removable singularities, 
etc. 

§4. Smooth generic submanifolds and their CR orbits 

4.1. Definitions of CR submanifolds and local graphing equations. We 

begin by some coordinate-invariant geometric definitions. Some implicit 
lemmas are involved (the reader is referred to llChl989llChl991[|Bo"1991[ 
IBER 199911 ). Let J denote the complex structure of TC" (see §2.1(11)). A 
real connected submanifold M C C" of class at least is called: 

• Totally real if TpM n JTpM = {0} for every p e M. Then M 
has codimension d ^ n and is called maximally real if d = n. The 
complex vector subspace Hp := TpM + JTpM of TpC" has com- 
plex dimension 2n — d. If proj^:^^ (■) denotes any C-linear projection 
of TpC" onto Hp and if Up is a small neighborhood of p in C", then 
proJj|^^(M nUp) is maximally real in Hp. 

• Generic if TpM + JTpM = TpC' for every p e M. Then M has 
codimension d ^ n and is maximally real only if d = n. Then 
TpM n JTpM is the maximal C-linear subspace of TpM and has 
complex dimension equal to the integer m := n — d, called the CR 
dimension of M. It is obviously constant, as p runs in M. 

• Cauchy-Riemann (CR for short) if the maximal C-linear subspace 
TpM n .JTpM of TpM has constant dimension m (necessarily ^ n) 
for p running in M. If M has codimension d, the integer c : = 
d — n + m is called the holomorphic codimension of M. Then for p 
running in M, the complex vector subspaces Hp := TpM + JTpM 
of TpC" have constant complex codimension c, which justifies the 
terminology. If pro}jj^{-) denotes any C-linear projection of TpC" 
onto Hp, and if Up is a small open neighborhood of p in C", then 

Mp := proj^^(MnWp) 
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is a generic submanifold of C"^^. 

In §2. 1(11), we have graphed totally real, generic and, generally, Cauchy- 
Riemann local submanifolds M C C"^, but only in the algebraic and in the 
analytic category. In the smooth category, the intrinsic complexification 
{w2 = 0} disappears, but Hp = TpM + JTpM still exists, so that further 
graphing functions are needed. 

Theorem 4.2. ( llChl989[ IChl991[ IBol991[ IBER1999[ IMe2004all ) Let 

M C be a real submanifold of codimension d and let p G M. There 
exist complex algebraic or analytic coordinates centered at p and pi > 
such that M, supposed to be C^, where IZ = oo or where IZ = (k, a), 
K 1, ^ a ^ 1, is locally represented as follows: 

• If M is totally real, letting di = 2n — d ^ and c = d — n ^ 0, 
then di + c = n and 

M = {{wi,W2) e [nf^ X iR"^') X : 

Imwi = (pi(Rewi),W2 = 'i^2(Re Wi)}, 

for some R'^'^ -valued map ipi and some C'^ -valued map ?/'2 
satisfying (pi{0) = and V^2(0) = 0. 

• If M is generic, letting m = d — n, then m + d = n and 

M = {{z,w) e A"^^ X (n;^^ X : Imw = (p{Re z,lm z,Rew)} , 

for some R'^-valued map ip satisfying ip{0) = 0. 

• T/'M /5 Cauchy-Riemann, letting m = CRdimM, c = d—n+m ^ 
0, and di = 2n — 2m — d ^ 0, then m + di + c = n and 

M ={{z,Wi,W2) G A™ X [nf^ X iR"^') X : 

Imwi = (fiiRez, Imz, Rewi), W2 = 4'2{Rgz, Imz, Rewi)}, 

for some R"^^ -valued map (pi with (pi{0) = and some 
C^-valued map ?/'2 with tp2{^) = which is CR (defini- 
tion in §4.25 below) on the local generic submanifold : = 

{{z,wi) e A™ X [D'^pl X iM^i) : Imwi = <pi{Re z,lm z,Rewi)}. 

An adapted linear change of coordinates insures that the differentials at 
the origin of the graphing maps all vanish. 

A CR manifold M being always locally graphed above a generic sub- 
manifold of C"~'^, the remainder of this memoir will mostly be devoted 
to the study of C°° or C'" generic submanifolds of C'. The above local 
representation of a generic M will be constantly used. 
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4.3. CR vector fields. Let M be generic, of class at least C^, represented 
by V = (p{x,y,u) as above, in coordinates {z,w) = {x + iy,u + iv). 
Sometimes, we shall also write v = Lp{z,u), being it clear that (p is not 
holomorphic with respect to z. Here, we provide a description in coordi- 
nates of three useful families of vector fields. 

There exist m anti-holomorphic vector fields defined in 
A^^ X (D^^ X iR'^) of the form: 

j=i J 

whose restrictions to M span T^'^M. To compute the coefficients a'j ^, the 
conditions = "~ '^j) yield: 

d 
1=1 

In matrix notation, the solution is: a' = 2 {ildxd — '^u)~^ ■ '^z^ with 
= («;,fc)iS&" and = both of size d X m. Since 

[T^'^Af, T^'^M] C T^'^M, the l'^, commute. They are extrinsic. 
Also, there exist m intrinsic sections of CTM of the form: 

j=i J 

written in the coordinates (x, y, u) of M , which span the structure bundle 
T°'^M C CTM. Since (x, n) are coordinates on M, restricting the 
Lj^\m to M amounts to just drop the terms f ^ in each g|- appearing in 

l'j^. Hence: 

Lemma 4.4. One has aj^k = | a'j i^. 

Another argument is to first introduce the d vector fields: 

1=1 ' 

that are uniquely determined by the conditions 

^ji,j2 = Kji (^i2lAf) = % {uj^ + m2{x, y, u)) . 
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Equivalently, the coefficients bij satisfy: 

d 

1=1 

whence, in matrix notation: h = {Idxd + i fu)~^ ■ Here, b = (&«,j)i<;<^ 
and Lfu = (</'i,«i)l<j<l both are x matrices. 

Similarly as in Corollary 3.27, the Lk defined above span the structure 
bundle C = T'^'^M having the local integrals 2i, . . . , Zm, wi\m, • • • , Wd\M, 
if and only if they satisfy = (wjIa/ ) = Lk [uj + i (pj{x, y, u)]. Seek- 
ing the Lk under the form Lk = + Ya=i ci,k{^,y,u) Ki, it follows 
from (5jjj2 = Kj-^ {uj.^ + iipj^{x,y,u)) that = —iipj^^k- Reexpressing 
explicitly the Ki in terms of the as achieved above, we finally get in 

matrix notation a = {i Idxd — ^u)~'^ -fs- This yields a second, more intrin- 
sic computation of the coefficients ^ and a second proof of aj^k = \ ct^k- 
If X is a C°° or C'" function on M, its differential may be computed as 

m m d 

dx = ^ Lkix) dzk + X Lkix) dzk + ^ Kj{x) dwj\^. 

k=l k=l j=l 

Lemma 4.5. ( IITrvl981[lBRTM7lllYvT992llBCH2005ll ) The following re- 
lations hold: 

r Lk.izk^) = 4i,fc2, Lk{wj) = 0, Kj{zk) = 0, Kj^{wj2\M) = Sj^j^, 
[ [Lk,,Lk,] = [Lk,Kj] = [Kj„K,,] = 0. 

4.6. Vector- valued Levi form. Let p E M and denote by Hp the projection 

CTpM — > CTpM/ {Tl'^^M © T^'^M). 

Definition 4.7. The Levi map at p is the Hermitian C^-valued form acting 
on two vectors Xp, G T^'^M as: 

" £p : Tl'^M X Tl'Hl — > CTpM / {T^'^^M © T°'^M) 

ilp{Xp,Yp):=^^7rp{[X,Y]ip)), 

where X, Y are any two sections of T^''^M defined in a neighborhood of p 
satisfying X{p) = Xp, Y{p) = Yp. The resulting number is independent 
of the choice of such extensions X, Y. 

As p varies, this yields a smooth bundle map. The Levi map Hp is non- 
degenerate at p if its kernel is null: £p(Xp, Yp) = for every Yp implies 
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Xp = 0. On the opposite, M is Levi-tiat if the kernel of £p equals T^'^M 
at every p. If M is a hypersurface (d = 1), one calls £,p the Levi form at 
p. Then M is strongly pseudoconvex at p if the Levi form £p is definite, 
positive or negative. These definitions agree with the ones formulated in 
§3.10 for abstract CR structures. 

Theorem 4.8. ( IIFrl977[IChT99T1l ) In a neighborhood Up of a point p e M 
in which the kernel of the Levi map is of constant rank and defines a C^, 
C°° orC'^~^'°' (k ^ 2,0 ^ a ^ 1) distribution of rrii-dimensional complex 
planes Pq C TqM, \/ q G Up, the distribution is Frobenius-integrable, 
hence M is C^, or C'^~^'°' foliated by complex manifolds of dimension 
nil. 

In particular, a Levi-fiat generic submanifold of CR dimension m is foli- 
ated by m-dimensional complex manifolds. These observations go back to 
Sommer (1959). In llChl991|| , one founds a systematic study of foliations 
by complex and by CR manifolds. 

4.9. CR orbits. Let M C C" be generic and consider the system L of 
sections of T'^M. To apply the orbit Theorem 1.21, we need M to be at 
least C^, in order that the flows are at least C^. By definition, a weak T'^M - 
integral submanifold S C M satisfies TpS D T^M, at every point p G S. 
Equivalently, S has the same CR dimension as M at every point. 

In the theory of holomorphic extension exposed in Part V, local and 
global CR orbits will appear to be adequate objects of study. They consti- 
tute one of the main topics of this memoir. 



Proposition 4.10. ([ |Trpl990[ ITul990[ ITul994a[ IMel994[ IJo 19961 



lMP1999l lMP200a ) Let M C be generic of class C^, C°° or C^'" with 
K ^ 2 and ^ a ^ 1. 

(a) The (global) T'^M-orbits are called CR orbits. They are denoted 
by OcR or by Ocr{M,p), if the reference to one of point p G Ocr 
is needed. 

(b) The local CR orbit of a point p E M is denoted by 0''^'^{M,p). 
It is a local submanifold embedded in M, closed in a sufficiently 
small neighborhood ofp in M. 

(c) Local and global CR orbits are C^, C°° or C^'^, for every [3 with 
Q < [3 < a. 

(d) M is partitioned in global CR orbits. Each global CR orbit is injec- 
tively immersed and weakly embedded in M, is a CR submanifold 
o/C" contained in M and has the same CR dimension as M. 
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(e) Every {immersed) CR submanifold S C M having the same CR 
dimension as M contains the local CR orbit of each of its points 

(f) CR orbits of the smallest possible real dimension 2m = 
2CRdimM satisfy TpOcR = TpOcB. every point, hence are 
complex m-dimensional submanifolds. 

According to Example 1.29, CR orbits should be not smoother. 

But in generic submanifolds, they also can be described as boundaries 
of small attached analytic discs ( HTu 19901 ITul994a[ IMel994ll ) and the 
QK,a-o _ [^^^^ smoothness of the solution in Theorem 3.7(IV) ex- 
plains (c). 

Let us summarize some structural properties of CR orbits, useful in ap- 
plications. A specialization of Theorem 1.21(4) yields the following. 

Proposition 4.11. For every p E M, there exist k eN, sections L\ . . . , L'^ 
ofT^M and parameters s^, . . . , G M such that -^s* (' ' ' (-^s* (p)) ' ' ' ) = P 

and the map (si, . . . , s^) i — > ^s^i' ' ' i^liip)) ' ' ') ^^^^ 
dimOcR{M,p) at (s^ . . . , s^). 

The dimension of any Ocr is equal to 2m + e, for some e G N with 
^ e ^ d. Denote: 

• 02m+e C M the union of CR orbits of dimension = 2m + e; 

• ^^m+e ^ ^ the union of CR orbits of dimension ^ 2m + e; 

• ^fm+e *^ ^ the union of CR orbits of dimension ^ 2m + e. 
The function p ^ dim.OcR{M,p) is lower semicontinuous. It follows 

that 02m+e oP^ii i'^ ^^^^ that Cf^+e is closed in M. 

Let p E M, let Op be a small piece of Ocr{M,p) passing through p, 
of dimension 2m + e^, for some integer Cp with ^ Cp ^ rf, and let Hp 
be a local C°° or C'" submanifold of M passing through p and satisfying 
TpHp®TpOp = TpM. Call iJp a local orbit-transversal. Implicitly, Hp = {l) 
if Cp = d. Then, in a sufficiently small neighborhood of p: 

• lower semi-continuity: Hp fl C^+gp+i = 0; 

• equivalently: Hp n = Hpf} Oam+e,; 

• Hp n 02!+,^ is closed. 

Proposition 4.12. If M is C^, then at every point p E M, for every orbit- 
transversal Hp passing through p, the closed set Hp fl C^+gp is a local 
real analytic subset of Hp containing p. 
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A CR-invariant subset of M is a union of CR orbits. A closed (for the 
topology of M) CR-invariant subset is minimal if it does not contain any 
proper subset which is also a closed CR-invariant subset. 

Problem 4.13. Describe the possible structure of the decomposition of M 
in CR orbits. 

There are differences between embedded and locally embeddable 
generic submanifolds, which we shall not discuss, assuming that M 
is embedded in C" or in Pn(C). Also, the category enjoys special 
features. 

Indeed, if M is a connected real analytic hypersurface. Proposition 4.12 
entails that each minimal closed invariant subset of M is either an embed- 
ded complex hypersurface or an open orbit; also if M contains at least one 
CR orbit of maximal dimension {2n — 1) (hence an open subset of M), 
all its CR orbits of codimension one are complex (n — 1) -dimensional em- 
bedded submanifold of M (a real analytic subset of codimension one in M 
consists of isolated points). In the smooth category things are different. 

So, let M be a connected C°° or C'" (k ^ 2, ^ a ^ 1) hypersur- 
face of C". Its CR-orbits are either (2n — 1) -dimensional, i.e. open in 
M, or {2n — 2) -dimensional and T'^M-integral, hence complex {n — 1)- 
dimensional hypersurfaces immersed in M. 

Proposition 4.14. ( ||Jol999all ) In the smooth category, the structure of ev- 
ery minimal closed CR-invariant subset C of M has one of the following 
types: 

(i) C = M consists of a single embedded open CR orbit; 

(ii) C = UaeA ^CR,a = M is a union of complex hypersurfaces, each 
being dense in C, with Card A = Card M; 

(iii) C = UaeA ^CR,a has empty interior in M and is a union union 
of complex hypersurfaces, each being dense in C, with Card A = 
CardM; 

(iv) C consists of a single complex hypersurface embedded in M. 

Furthermore, the closure, with respect to the topology of M, of every 
CR orbit of dimension (2n — 2) is a minimal closed CR-invariant subset of 
M. 

These four options are known in foliation theory ( nHH1983[|CLN19^5l ). 
One has to remind that each CR orbit contained in C is dense in C. In the 
first two cases, the trace of C on any orbit-transversal is a full open seg- 
ment; in the third, it is a Cantor set; in the last, it is an isolated point. In the 
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third case, impossible if M is real analytic, C will be called an exceptional 
minimal CR-invariant subset, similarly as in foliation theory. We shall see 
below that compactness of M C C" imposes a strong restriction on the 
possible C's. 

We mention that an analog of Proposition 4.14 holds for connected 
generic submanifolds of codimension d ^ 2, provided one puts the re- 
strictive assumption that all its CR orbits are of codimension ^ 1, the only 
difference being that CR orbits of codimension 1 are not complex mani- 
folds in this case. 

The presence of CR orbits of codimension ^ 2 in M may produce min- 
imal closed CR-invariant subsets with complicated transversal structure, 
even in the real analytic category ( nBM1997ll ). Also, in a bounded strongly 
pseudoconvex boundary (see §1.15(V) for background), there may exist 
a CR orbit of codimension one whose closure constitutes an exceptional 
minimal CR-invariant subset. 

Theorem 4.15. ( [|Jol999all ) There exists a bounded strongly pseudoconvex 
domain f2 C with C°° boundary and a compact C°° submanifold M C 
dVt of dimension 4 which is generic in such that: 

• M is foliated by CR orbits of dimension 3; 

• M contains a compact exceptional minimal CR-invariant set, but 
no compact CR orbit. 

Summarized proof. The main idea is to start with an example due to Sack- 
steder, known in foliation theory, of a compact real analytic 3-dimensional 
manifold H equipped with a foliation JF of codimension one which car- 
ries a compact exceptional minimal set, but no compact leaf. According 
to [IHH1983L there exists such a pair (A/", JF), together with a diffeo- 
morphism (pi : J\f ^ B x S^, where B is some compact orientable 
surface of genus 2 embedded in M^, and where is the unit circle. Let 
B 3 h ^ n(6) G T}M? denote the C°° unit outward normal vector field to 
such a i? C M'^, and consider M? to be embedded in C'^. For £ > small, 
the map 

if 2- B X 3 {hX)^h + n{b) -eCeC^ 
may be seen to be a totally real embedding. By results of Bruhat- 
Whitney and Grauert, one may approximate the C°° totally real embedding 
ip2 o by a embedding ip : J\f ^ which is arbitrarily close to 
ip2 o Lfi in norm, hence totally real. Denote := V'(A/'). The trans- 
ported foliation F := ip^{J-') being real analytic, one may then proceed 
to an intrinsic complexification of all its totally real 2-dimensional leaves. 
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getting some 5-dimensional real analytic hypersurface N^" containing N, 
equipped with a foliation F*"^ of A^*'^ by 2-dimensional complex manifolds, 
with F"^" n N = F. This foliation F''" is closed in some tubular neigh- 
borhood of in say Q := {z e C"^ : dist(2, A^) < 6}, with 
S > small. Since is totally real, the boundary d^l is strongly pseudo- 
convex (Grauert) and is C°°. Clearly, the intersection M := N''" fl dCl is 
a 4-dimensional C°° submanifold. The intersections of the 2-dimensional 
complex leaves of F^" with d^l show that M is foliated by strongly pseudo- 
convex 3-dimensional boundaries, which obviously consist of a single CR 
orbit. Thus a CR orbit of M is just the intersection of a global leaf of F^'= 
with d^l. In conclusion, letting Excj^ be the minimal exceptional set of 
Sacksteder's example, M contains the exceptional minimal CR-invariant 
set [(p^{Excjr)]'"' n dil and no compact CR orbit. □ 

4.16. Global minimality and laminations by complex manifolds. The 

CR orbits being essentially independent bricks, it is natural to define the 
class of CR manifolds which consist of only one brick. 

Definition 4.17. A C^, C°° or C''' CR manifold M is called globally min- 
imal if if consists of a single CR orbit. 

Each CR orbit of a CR manifold is a globally minimal immersed CR 
submanifold of C". To simplify the overall presentation and not to expose 
superficial corollaries, almost all the theorems of Parts V and VI in this 
memoir will be formulated with a global minimality M. 

Lemma 4.18. ( IIGrl968[|J5T995llBCH2005]l ) A compact connected hy- 
persurface in is necessarily globally minimal. 

Proof. Otherwise, the closure of a CR-orbit of codimension one in M 
would produce a compact CR-invariant subset C which is a union of im- 
mersed complex hypersurfaces, each dense in C . Looking at a point of 
C where the pluriharmonic function := Re^j (or Si := Irazi) is max- 
imal, the maximum principle entails that (or Si) is constant on C, for 
i = 1, . . . , n, hence C = {pt.}, contradiction. □ 

More generally, the same simple argument yields: 

Corollary 4.19. Any Stein manifold cannot contain a compact set which is 
laminated by complex manifolds 

In the projective space P„(C), one expects compact orientable con- 
nected hypersurfaces M to be still globally minimal, but arguments 
are far to be simple. In fact, there are infinitely many compact projective 
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algebraic complex hypersurfaces S in -P„(C). However, they cannot be 
contained in such an M C -P„(C) since, otherwise, their complex normal 
bundle TP„(C)|e/TS, known to be never trivial, but equal to the com- 
plexification of the trvial bundle TAf l^/TS, would be trivialized. 

Thus, according to Proposition 4.14 above, the very question is about 
nonexistence of closed CR-invariant sets C C Af laminated by complex 
hypersurfaces which either coincide with M or are transversally Cantor 
sets. If M C -Pn(C) is real analytic, it might only be Levi-flat. 

Nonexistence of orientable Levi-flat hypersurfaces in P„(C) was ex- 
pected, because they would divide the projective space in two smoothly 
bounded pseudoconvex domains. In the real analytic case, non-existence 
was verified by Lins-Neto for n ^ 3 and by Ohsawa for n = 2; in the 
smooth (harder) case, see HSilOOOII . 

Open question 4.20. Is any compact orientable connected hypersur- 
face ofPn^C) globally minimal ? 

So, the expected answer is yes. In fact, the question is a particular 
case of a deep conjecture stemming from Hilbert's sixteen problem about 
phase diagrams of vector fields having polynomial coefficients on the two- 
dimensional projective space. This conjecture is inspired by the Poincare- 
Bendixson theory valid over the real numbers, according to which the clo- 
sure of each leaf of such a foliation over P2(IR) contains either a compact 
leaf or a singularity. In its most general form, it says that Pri(C) cannot 
contain a compact set laminated by (n — 1) -dimensional complex manifold, 
unless it is a trivial lamination, viz just a compact complex projective alge- 
braic hypersurface; however, nontrivial laminations by (n— 2) -dimensional 
complex manifolds may be shown to exist. 

A related general open question is to find topologico-geometrical criteria 
on open subsets of P„(C) insuring the existence of nonconstant holomor- 
phic functions there. 

4.21. Finite-typisation of generic submanifolds. Let M be a connected 
C (2 ^ K ^ oo) generic submanifold of C" of codimension 1 and of 
CR dimension m = n — d ^ 1. The distribution of subspaces p i— > T^M 
of TM is of constant rank 2m. We apply to the complex tangential bundle 
T^M the concept of finite-type. 

Definition 4.22. A point p e M is said to be of finite type if the system L 
of local sections of T^M defined in a neighborhood of p satisfies L'^(p) = 
TpM. The smallest integer d{p) ^ k with h'^^P^p) = TpM is called the 
type of M at p. 
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We want now to figure out how, in general, a generic submanifold of 
C" must be globally minimal and in fact, of finite type at every point. We 
equip with the strong Whitney topology the set '^Gdm of C (2 ^ k ^ oo) 
connected generic submanifolds M C C" of codimension d ^ 1 and of 
CR dimension m = n — d ^ 1. No restriction is made on the global 
topology. 

As a model case, let k ^ 2 and consider M to be rigid algebraic repre- 
sented by 



Wj = Wj + i Pj{z, z) = Wj + i Pj,a,/3 z'^z'^, 

\a\+m<iK 



where a, /? G N™, where the polynomials Pj are real, Pj,a,f3 = Pj,f3,a ^^'^ 
have no pluriharmonic term, namely = Pj{z,0) = Pj{0,z), for j = 
1, . . . ,d. A basis of (1, 0) and of (0, 1) vector fields is given by 

g ^ Q _ Q ^ Q 

^fc •= ^ ^ ^ ^i.^fc a — ^^'^ ■■= T— - i Y] Pj,zk T—, 

dzk ^ dwj dzk ^ dwj 

for k = 1, . . . , n. The Lie algebra L** generated by all Lie brackets of 
length ^ K of the system L := {L^, Lk}i<^Ks^m contains the subalgebra 
^CR,rigid generated by the only brackets of the form 

[Lai, . . . , [La„, [Lf,^,. . . , [Lf,^, [Lfcj, LfcJ] •••]]•••] 

where 2 + a + b ^ k and where 1 ^ Ai, . . . , Aa, /ii, . . . , /ib, /ci, A;2 ^ m. 
One computes 

\j=l j=l 
hence the above iterated Lie brackets are equal to 

TP - - - -^ + Tp- _ _ _ 1_ 

This shows that all these brackets are linearly independent as functions of 
the jets of the Pj. In fact, the number of such brackets is exactly equal to 
the dimension of the space of polynomials P(z, z) of degree ^ k having 
no pluriharmonic term, namely equal to 

{2m + k)\ ^{m + K)\ ^ 
2m! k\ ml k\ 
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For a general submanifold M (not necessarily rigid), one verifies that 
the same collection of brackets is independent in terms of the jets of the 
defining equation of M. Generalizing slightly Lemma 2.13, we see that in 
the vector space of d x (d + e) (real or complex) matrices, the subset of 
matrices of rank ^ (i — 1 is a real algebraic set of codimension equal to 
(e + 1). If we choose k. large enough so that the dimension of ^cR,rigid 
is ^ d + dim M = 2{m + d) = 2n (applying the previous assertion with 
e := dim M ), if we form the d x (d + e'), e' ^ e, matrix consisting of the 
coordinates of the ^-part of brackets of length ^ k as above, then the set 
where this matrix is of rank ^ — 1 is of codimension ^ dim M + 1 in 
the space of n-th jets of the defining equations of M. Consequently, the jet 
trans versality theorem applies. 

Theorem 4.23. Let n ^ 1, m ^ 1 and d ^ 1 be integers satisfying 
m + d = n and let k be the minimal integer having the property that 

\ , , -2 ^ , , +1^2(m + rf) = 2n. 
2m! k\ ml k\ 

Then the set ofC^ connected generic submanifolds M C C" of codimen- 
sion d and of CR dimension m that are of finite type ^ n at every point is 
open and dense in the set ^Qdm of all generic submanifolds. 

In particular, a connected (resp. C^, resp. C^) hypersurface in 
(resp. in C"^, resp. in C" for n ^ 4) is of finite type 4 (resp. 3, resp. 
2, or equivalently, is not Levi-flat) at every point after an arbitrarily small 
perturbation. 

Similarly, if instead of the subalgebra LcR.ngid ^ one would have 
considered the (smaller) subalgebra consisting of only the brack- 
ets [Lai, . . . , [La„, [Lfc^, Lfcj]] . . .], where 2 + a k and where 
1 ^ Ai, . . . , Aa, ki, k2 ^ K, one would have obtained finite type ^ k, for 
K minimal satisfying 2m ^ m^ + 2 (2m + d). We also mention 

that the same technique enables one to prove that, after an arbitrarily 
small perturbation, M is finitely nondegenerate at every point and of finite 
nondegeneracy type ^ i, with i minimal satisfying 2d ^|f^ ^ An — 1. In 
particular, i = 3 when m = d = 1 while £ = 2 suffices when m = 1 for 
all c? ^ 2. Details are left to the reader. 

To conclude, we state the analog of Open question 2.17 for induced CR 
structures. 

Open question 4.24. ( I1JS2004L [*]) Given a fixed generic submanifold 
M of class C that is of finite type at every point, is it always possible 
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to perturb slightly a submanifold Mi of M that is generic in C", of 
codimension di ^ 1 and of CR dimension mi = n — di ^ 1, as a 
submanifold Mi of M that is of finite type at every point ? If so, what is 
the smallest regularity n in terms ofd, m, di, mi and of the highest type at 
points ofM ? 

4.25. Spaces of CR functions and of CR distributions. A function 
/ : M ^ C is called Cauchy-Riemann (CR briefly) if it is annihilated by 
every section of T°'^ M. Equivalently: 

• df is C-linear on T^M; 

• df A dti A ■ ■ ■ A dtn \ = 0; 

• Jj^j f dcu = 0, for every form cu of type (n, m — 1) in C" having 
compact support. 

(Remind the local expression of (r, s) forms: j ajj dt^ A dt^ , where 
I = {ii,...,ir) and J = (ji, . . . , js)-) A (only) continuous function 
/ : M C is CR if the last condition /^^ fdcu = holds. Fur- 
ther, Lebesgue-integrable CR functions, CR measures, CR distributions 
and CR currents may be defined as follows ( IITrv 198 1[ ITrv 1992[ IHMT9981 
Trpl9961lJ5T999b]l ). 

Thanks to graphing functions, one may equip locally M with some (in 
fact many) volume form, or equivalently, some deformation of the canoni- 
cal dim M-dimensional Legesgue measure defined on tangent spaces. Let 
p be a real number with 1 ^ p ^ oo. Since two such measures are multiple 
of each other, it makes sense to speak of functions M — > C. In this 
setting, a L'f^^{M) function / is CR if /^^ f dm = 0, for every form to 
of type (n, m — 1) in C" having compact support. 

A distribution T on M is CR if for every section L of T°'^M defined in 
an open subset U C M and every x ^ C^{U, C), one has (T, L{x}) = 0. 

A CR distribution of order zero on M is called a CR measure. Equiv- 
alently, a CR measure is a continuous linear map cu' t-^ P-{^') from com- 
pactly supported forms on M of maximal degree 2m + d to C, that is CR in 
the weak sense, namely ^{du) = 0, for every form on of type (ra, m — 1) 
having compact support. Once a volume form dvoU/ is fixed on M, the 
quantity fi dvoljv/ is a CR (Borel) measure on M. 

4.26. Traces of CR functions on CR orbits. A function f : M ~> 
C is CR on M if and only if its restriction to every CR orbit of M is 
CR (obvious). If / is C° or Lj^^^, a similar but nontrivial statement holds. 



100 



JOEL MERKER AND EGMONT PORTEN 



By "almost every CR orbit", we shall mean "except a union of CR orbits 
whose dim M-dimensional measure vanishes". 

Theorem 4.27. {d = 1: [|Jol999bll : d ^ I: IIPol997[|MPT999ll ) Assume 
that M is at least and let f be a function in L'^^^^M) with 1 ^ p ^ 
oo. Then the restriction f\ocR ^oc ^cw far almost every Ocr- 
Furthermore, f is CR if and only if, for almost every CR orbit Ocr of M, 
its restriction f\ocR 

The theorem also holds for / continuous, with f\ocR being CR for every 
CR orbit. Here, C'^-smoothness is needed. Property (5) of Sussman's orbit 
Theorem 1.21 together with a topological reasoning yields a covering by 
orbit-chart which is used in the proof. 

Proposition 4.28. ( IIJol999allPoT997llMP199"9ll ) Assume M is C°° or C'''", 
with K,^2, O^a^l and let □ := {x G M : |x| < 1}. There exists a 
countable covering IJ^gn Uk = M such that for each k, there exist G N 
with ^ ek ^ d and a diffeomorphism: 

such that: 

• ipk X {tl}) is contained in a single CR orbit, for every 

fixed tl G W^-^^; 

• for each p E M, there exists k = kp E N with p G Uk^, 
viz there exist Skp,p and tkp,p with (fkp{skp,p-,tkp,p) = P, such that 
Lfk^ ^n^^i+efep X {tfcp^p}) is an open piece of the CR orbit of p, i.e. 
dimCci?(M,p) = 2m + Cfc,. 

In the proof of the theorem, C^-smoothness of the maps (fk (hence C'^- 
smoothness of M) is required to insure that the pull-back ip*j^{T^M\u^) is 
C^. However, we would like to mention that if M is C^'" with < a < 1 
resuks of IITul990[ [Tul994a[ lTuT996l and Theorem 3.7(IV) insuring the 
C^'^-smoothness of local and global CR orbits, for every (3 < a, this would 
yield orbit-charts Lp^ of class C^''^, and then the above theorem holds true 
with M of class C^'". 

4.29. Boundary values of holomorphic functions for functional spaces 

C'", V, L\^^. Let M be a generic submanifold of C" of codimention d ^ 
1 and of nonnegative CR dimension (we admit m = 0). Assume M 
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is at least C^. In appropriate coordinates t = {z, w) = {x + iy, u + iv) G 
C" X C" centered at one of its points p: 

M={{z,w)e A™ X (Dj^ X zM'^) : v = ^{x, y,u)} , 

for some pi > 0, with (/?(0) = and d^p^O) = 0. Let p be a real number 
with ^ p ^ pi. The height function: 

f^(p) := , max \^{x,y,u)\ 

is continuous and tends to 0, as p tends to 0. For every p ^ pi and every 
a > o-{p), the boundary of M fl [A™ x (D^ x zD^)] is contained in the 
boundary d (A^ x D^) of the horizontal space, times the vertical space 

Let C be an open convex cone in M'^ having vertex 0. We shall assume 
it to be salient, namely contained in one side of some hyperplane passing 
through the origin. Equivalently, its intersection C fl S'^"^ with the unit 
sphere of is open, contained in some open hemisphere and convex in 
the sense of spherical geometry. 

A local wedge of edge M at p directed by C is an open set of the form: 

(4 30) ^ ^ a,C):={ix + ty,u + iv) e A^' x x lUt : 

V - (p{x,y,u) e C}, 

for some p, a > satisfying p ^ pi and a > cr{p). This type of open 
set is independent of the choice of local coordinates and of local defining 
functions; in codimension d ^ 2, it generalizes the notion of local side of 
a hypers urf ace. Notice that W is connected. 

If there exists a function F that is holomorphic in W and that extends 
continuously up to the edge 

Mp:=Mn [A™ X (n;^ x iR'^)] 

of the wedge W, then the limiting values of F define a continuous CR 
function on Mp. 

A more general phenomenon holds. A function F, holomorphic in the 
wedge W, has slow growth up to M, if there exist k E N and C > such 
that 

\F{t)\ ^ C\v - (p{x,y,u)\~^ , t= {x + iy,u + iv) e W. 

Equivalently, \F(t)\ ^ C [dist(t, M)]~^, with the same k but a possibly 
different C. As in the cited references, we shall assume M to be C°°. 
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Theorem 4.31. ( IIBCT1983[ IHol985l IBR1987[ IBER1999II ) // 

F G C(W(p, cr, C)) has slow growth up to M, it possesses 
a boundary value huF which is a CR distribution on the edge 
M n [A™ X (n^ X zD^)] precisely defined by: 

{huF^x) '■= liin / F {x + iy,u + iip{x,y,u) + i9) ■ 

■ xi^y u) dx dydu, 
where x = xi^y '■^ ^ C°° function having compact support in x D^. 

(i) The limit is independent of the way how 9 E C approaches G M.'^. 

(ii) IfbAiF is C^'^, A ^ 0, ^ /3 ^ 1, then F extends as a C^'^ 
function on W U (M n [A™ x (D;^ x D^,)]), for every wedge 
W = W'{p, a', C) with a{p) < a' ^ a and with C n S'^-^ CC 

C n S'^-\ 

(iii) Finally, F vanishes identically in the wege W if and only ifbuF 
vanishes on some nonempty open subset of the edge Mp. 

The integration is performed on the translation := Mp + (0,i6'), 
drawn as follows. 




Boundary values of functions holomorphic in a wedge 



The proof is standard for M = M" ( HHd 198511 '). the main argument going 
back to Hadamard's finite parts. With technical adaptations in the case of 
a general generic M, several integrations by part are performed on a thin 
(dim M+1) -dimensional cycle delimited by M° and M^, taking advantage 
of Cauchy's classical formula, until the rate of explosion of F up to the 
edge is dominated. The uniqueness property (iii) requires analytic disc 
methods (Part V). 
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Boundary values in the sense requires special attention. At first, re- 
mind that a function F holomorphic in the unit disc A belongs to the Hardy 
class ifP(A) if the supremum: 

(PTT \ 1/P 

J-w J 

is finite. According to Fatou and Privalov, such a function F has radial 

boundary values /(e**) := lim^^i F(re**), for almost every t E [—71,71], 

< 

so that the boundary value / belongs to L^{[—7i, tt]). Furthermore, if 1 ^ 

p < 00: 

/TT 
|F(re^*) -/(e**)^ = 0. 
^ -TT 

Consider a bounded domain D C C" having boundary of class at least C^, 
defined by D = {2; G C" : p{z) < 0}, with p e satisfying dp 
on dD. For e > small, let D^; := {z E D : p{z) < —e}. The induced 
Euclidean measure on dD^ (resp. dD) is denoted by rfag (resp. da). Then 
the Hardy space H^(D) consists of holomorphic functions F E 0{D) 
having the property that the supremum: 

\\F\\hp(d)-=^^p( [ dae{z)] < 00 

e>0 \JdD, J 

is finite. The resulting space does not depend on the choice of a defin- 
ing function p ( nStl972|| ). Let be the outward-pointing normal to the 
boundary at z G dD. 

Theorem 4.32. ( IIStl972ll ) If F E E^[D), for almost all z E dD, the 

normal boundary value f{z) := lime^o F {z — en^) exists and defines a 

> 

function f which belongs to L^{dD). Furthermore, ifl^p< 00: 



> 



lim / \F{z-£n,) - f{z)\^ da{z) = 0. 

e—*0 



dD 



In arbitrary codimension, the notion of boundary values may be de- 
fined in the local sense as follows. Let M be generic, let p E M and let 
yV = W(p, cr, C) be a local wedge of edge M at p, as defined by (4.30). A 
holomorphic function F E (9(W) belongs to the Hardy space Hi^^(yV) if 
for every cone C C with C" n S"*"^ CC C n S'^~^ and every p' < p, 
the supremum: 

sup / \F {x + iy,u + iip{x,y,u) + i9')\^ dx /\ dy /\ du < 00 

9'ec' Ja^xD'*, 
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is finite. Up to shrinking cubes, polydiscs and cones, the resulting space 
neither depends on local coordinates nor on the choice of local defining 
equations. 

Theorem 4.33. {d = 1: IIStl972[ |J5T999bll : d ^ 2: IIPol997ll ) If F E 

H^g^iyV), for almost (x, y,u + i (p{x, y, u)) e Mp and for every cone C 
with C n S'^~'^ CC C n S'^~^, the boundary value: 

f{x, y, u) := {x + iy,u + i ip{x, y,y) + i 6') 

exists and defines a function f which belongs to L'^^^^j^^Mp). Further- 
more, z/ 1 ^ p < oo, for every p' < p: 



4.34. Holomorphic extendability of CR functions in C °, V, L^^^. In 
Part V, we will study sufficient conditions for the existence of wedges to 
which CR functions and distributions extend holomorphically. 

Definition 4.35. A CR function of class C'^'" or L^,^ (1 ^ p < oo) or a CR 
distribution / defined on M is holomorphically extendable if there exists a 
local wedge W = W(p, a, C) atp and a holomorphic function F E C(W) 
whose boundary value b^-^ equals / on Mp in the C'", or V sense. 

4.36. Local CR distributions supported by a local CR orbit. Assume 
now that M, of class C°° and represented as in §4.3, is not locally minimal 
at p. Equivalently, (9^|j. (M, p) is of dimension 2m + e ^ 2m + — 1. In a 
small neighborhood, S := 0^§'j^{M,p) is a closed connected CR subman- 
ifold of M passing through p and having the same CR dimension as M. 
There exist local holomorphic coordinates {z,w) = {z,wi,W2) E x 
X C^^"^ vanishing at p in which M is represented by t> = Lp(x, y, u) and S 
is represented by the supplementary (scalar) equation(s) U2 = A2(x, y, Ui), 
with ip and A2 of class C°° satisfying (/?(0) = 0, d'p{Q) = 0, A2(0) = and 
d\2{0) = 0. According to Theorem 4.2, the assumption that S is CR and 
has the same CR dimension as M may be expressed as follows. 

Proposition 4.37. Decomposing ip = {(pi, ip2) and defining: 




f{x, y,u)\^ dx A dy A du = 0. 



vi = (pi (x, y, ui, A2(x, y, ui)) =: pi{x, y, ui), 
V2 = (P2 (x, y, ui, A2(x, y, ui)) =: p2{x, y, ui). 



the map: 



ip2{x, y, ui) := A2(x, y, Ui) + z/i2(x, y, ui) 
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is CR on the generic submanifoldvi = y, ui) ofC"^ x C^. 
In a small neighborhood U of p, the restrictions 

dzi\^, . . . ,dzm\g,dwi\^, . . .,dWe\g 

span an (m + e) -dimensional subbundle of CT*S. Denoting dz := dzi A 
■ ■ ■ A dzm, dz := dzi A ■ ■ ■ A dzm and dw' := dwi A ■ ■ ■ A dwe, for x G 
C'^{U, C), consider the (localized) distribution defined by: 

([S],x):= / X'dzAdw'Adz. 
Juns 

Proposition 4.38. ( flTrv 19921 IHT1993II ) Then [S] is a nonzero local CR 
measure supported by S nU. 

Proof. It is clear that [S] is supported hy S H U and is of order zero. 
Let the (0, 1) vector fields and the complex-transversal ones Kj be 
as in §4.3. Reminding dx = YlT=i Lk{x) dzk + XlHi Lk{x) dzk + 
Ei=i Kjix) dwj\^^, we observe: 

Lfc(x) dz A dw' Adz = ±d (^x ' dz A dw' A dzi A ■ ■ ■ A dzk A ■ ■ ■ A dzrr^^ . 
Replacing this volume form in the integrand: 

(L,[S],x>:=-([S],Ife(x)> = - / Lk{x)dzAdw' Adz 

J snu 

= ±/ d (x ' dz A dw' A dzi A ■ ■ ■ A dzk A ■ ■ ■ A dzm ] 

Jsnu ^ ^ 

and applying Stokes' theorem, we deduce (Lfc[S], x) = 0, i.e. [S] is CR. 

□ 

The last assertion of Theorem 4.31 and the vanishing of [S] on the dense 
open set U\{S fi U) entails the following. 

Corollary 4.39. ( IITrvl992[lHT 199311 ) The nonzero local CR measure [S] 
does not extend holomorphically to any local wedge of edge M at p. 

By means of this wedge nonextendable CR measure, one may construct 
non-extendable CR functions of arbitrary smoothness. Indeed, let M be a 
local generic submanifold with central point p, as represented in §4.3 and 
let Kj be the complex-transversal vector fields satisfying Kj^ {wj^) = dj-^j^ 
and[%,A^,] = 0. 
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Propositio n 4.40. ( IIBTiggli ITrvl981[ IBR1990[ ITrv 19921 IHT1996[ 
IBER 19991 ) For every CR distribution J on M and every k e N, there 
exist an integer jj, E 'H and a local CR function f of class C defined in 
some neighborhood ofp such that: 

l={Kl + ... + KlY f. 

Then with T := [S] and for k G N, an associated CR function / of class 
C is also shown to be not holomorphically extendable to any local wedge 
of edge M at p. A Baire category argument ( IIBR1990II ) enables to treat 
the C°° case. 

Theorem 4.41. ( [|BR1990[ IBER 199911 ) // M is not locally minimal at p, 
then for every k = 0,1,2,...,oo, there exists a CR function h of class C 
defined in a neighborhood ofp which does not extend holomorphically to 
any local wedge of edge M at p. 

Open problem 4.42. Find criteria for the existence ofCR distributions or 
functions supported by a global CR orbit. 

In HBM 19971 . this question is dealt with in the case of CR orbits of 
hypersurfaces which are immersed or embedded complex manifolds. 

To conclude this section, we give the general form of a CR distribution 
supported by a local CR orbit S = OQji{M,p). After restriction to S, the 
collection Ks '■= (Ke+i, ■ ■ ■ , K^) of vector fields spans the normal bundle 
to S in M, in a neighborhood of p. Let T be a local CR distribution defined 
on M that is supported by S. 

Theorem 4.43. ( IITrvl992[|BCH2005ll ) There exist an integer k e N, and 
for all P G N'^~'^ with ^ k, local CR distributions T^ defined on S such 
that: 

(T,X)= E {T'pAKsnx)\s)- 

§5. Approximation and uniqueness principles 

5.1. Approximation of CR functions and of CR distributions. Let M 

be a generic submanifold of C". The following approximation theorem 
has appeared to be a fundamental tool in extending CR functions holomor- 
phically (Part V) and in removing their singularities (Part VI). It is also 
used naturally in the proof of Theorem 4.43 just above as well as in the 
Cauchy uniqueness principle Corollary 5.4 below. The statement is valid 
in the general context of locally integrable structures C, but, as explained 
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in the end of Section 3, we decided to focus our attention on embedded 
Cauchy-Riemann geometry. 

Theorem 5.2. ( I1BT1981[ IHM1998[ IJol999b[ IBCH2005H ) For every p e 
M, there exists a neighborhood Up ofp in M such that for every function f 
or distribution T as defined below, there exists a sequence of holomorphic 
polynomials {Pk{z))j^^^ with: 

• if M is C^^'", with k > 0, ^ a ^ 1, if f is a CR function 
of class C'" on M, then limfc^oo \\Pk — /llc'=.«(;7p) ~^ 0' P*^^' 
ticular, continuous CR functions on a generic submanifold are 
approximable sharply by holomorphic polynomials; 

• if M is at least C^, if f is a L^^^ CR function (1 ^ p < oo), then 
limfc^oo \\Pk - /II LP 0; 

• if M is C^^^, if T is a CR distribution of order ^ k, on M, then 
limfc_oo = {T,x) for every xe C^{Up). 

In [|HM1998[ IBCH2005L convergence in Besov-Sobolev spaces L^^^^ 
and in Hardy spaces /i^, frequently used as substitutes for the spaces 
when < p < 1, is also considered, in the context of locally integrable 
structure. 

Proof. Let us describe some ideas of the proof, assuming for simplicity 
that M is and / is C^. In coordinates (ti, . . . , t„) vanishing at p, choose 
a local maximally real submanifold Aq contained in M, passing through 
p and satisfying T^Aq = {Ret = 0}. Let Vphe a small neighborhood of 
p, whose projection to TpM is a (2m + (i) -dimensional open ball. We may 
assume that Aq is contained in Vp with boundary Bq := Aq fl dVp being 
diffeomorphic to the (n — 1) -dimensional sphere. Consider a parameter 
u E M.'^ satisfying |n| < 5, with 5 > small. We may include Aq in a 
family (A„)|„|<5 of maximally real submanifolds of Up with A„|^^p = 
Aq, whose boundary is fixed: 9A„ = OAq = Bq, such that the A„ foliates 
a small neighborhood Up of p in M. For t E Up, there exists a u = u(t) 
such that t belongs to A„(t). We then introduce the entire functions: 

Fkit) ■= (-) ' I /(r) rfn A ■ ■ ■ A rfr„, 

where {t — t)'^ := J2]=i i^j ~ T?)^ ^'^^ where G N. Shrinking Vp and 
Up if necessary, we may assume that |Im {t — t)\ ^ ^ |Re (t — r)| for all 
t, r E A„ n f/p and all |n| < 5. Here, the C^-smoothness assumption is 
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used. With this inequality, the above multivariate Gaussian kernel is easily 
seen to be an approximation of the Dirac distribution at r = t on A„((). 
Consequently Fk{t) tends to /(t) as — oo. Moreover, the convergence 
is uniform and holds in C'^ (Up). 

We claim that the assumption that / is CR insures that Fk{t) has the 
same value if the integration is performed on Aq: 



Indeed, Au(t) and Aq bound a (n + 1) -dimensional submanifold con- 
tained in Vp with dUt = Au{t) — Aq. Since e~'^(*~^)^ is holomorphic with 
respect to r and since (i/(r) AdriA- ■ ■AdTn\^j = 0, because / is and CR, 

the (n, 0) form uj := e~'^(*~^)^ /(r) dr = is closed: du = 0. By an appli- 
cation of Stokes' theorem, it follows that = [„ du = [. cu — f. cu. 

Jilt -'Au(t) JJ^O 

which proves the claim. 

Finally, to approximate / by polynomials on Up in the C*^ topology, in 
the above integral (5.3) that is performed on the fixed maximally real sub- 
manifold Aq, it suffices to develop the exponential in Taylor series and to 
integrate term by term. In other functional spaces, the arguments have to 
be adapted. □ 

As a consequence, uniqueness in the Cauchy problem holds. It may 
be shown ( ||Trvl981l ITrv 199211 ) that the trace of a CR distribution on a 
maximally real submanifold always exists, in the distributional sense. 

Corollary 5.4. ( IITrv 1 98 lilTrv 199211 ) If a CR function or distribution van- 
ishes on a maximally real submanifold A of M, there exists an open neigh- 
borhood Ua of a in M in which it vanishes identically. 

Since every submanifold H of M which is generic in C"^ contains small 
maximally real sumanifolds passing through every of its points, the corol- 
lary also holds with A replaced by such a H. 

Proof. It suffices to localize the above construction in a neighborhood of 
an arbitrary point p G A and to take for Aq a neighborhood of p in A. The 
integral (5.3) then vanishes identically. □ 

Corollary 5.5. ( IITrv 198 11 ITrv 199211 ) The support of a CR function or dis- 
tribution on M is a closed CR-invariant subset of M. 

Proof. By contraposition, if a CR function or distribution vanishes in a 
neighborhood Up of a point p in M, it vanishes identically in the CR- 
invariant hull of Up, viz the union of CR orbits of all points q E Up. The 



(5.3) 
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CR orbits being covered by concatenations of CR vector fields, neglecting 
some technicalities, the main step is to establish: 

Lemma 5.6. Let p e M, let L be a section of T'^M and let q* = 
exp{s*L){p) for some s* G M. If a CR function or distribution vanishes 
in a neighborhood ofp, it vanishes also in a neighborhood ofq. 

Indeed, we may construct a one-parameter family (-f^s)o<s<s* of hy- 
persurfaces of M with q* E Hs* and with Hq contained in a small neigh- 
borhood of p at which the CR function of distribution vanishes already. 
As illustrated by the following diagram, we can insure that at every point 
qs = exp(sL)(p), the vector L(qs) is nontangent to Hs- 



integral curves of L 




Propagation of vanishing along the integral curve of a CR vector field 



It follows that the hypersurfaces Hs are generic in C", for every s. Then 
the phrase after Corollary 5.4 applies to each H^, from Hq up to Hs*, show- 
ing the propagation of vanishing. □ 

5.7. Unique continuation principles. At least three unique continuation 
properties are known to be enjoyed by holomorphic functions h of several 
complex variables defined in a domain D C C^. Indeed, we have /i = in 
either of the following three cases: 

(ucpl) the restriction of h to some nonempty open subset of D vanishes 
identically; 

(ucp2) the restriction of h to some generic local submanifold A of D van- 
ishes identically; 

(ucp3) there exists a point p E D at which the infinite jet of h vanishes. 

In Complex Analysis and Geometry, the (ucpi) have deep influence on 
the whole structure of the theory. Finer principles involving tools from 
Harmonic Analysis appear in llMP2006bL 
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Problem 5.8. Find generalizations of the (ucpi) to the category of embed- 
ded generic submanifolds M. 

Since a domain D of trivially consists of a single CR orbit, it is nat- 
ural to assume that the given generic manifold M is globally minimal (al- 
though some meaningful questions arise without this assumption, we pre- 
fer not to enter such technicalities). In this setting. Corollaries 5.4 and 5.5 
provide a complete generalization of (ucpl) and of (ucp2). 

A version of (ucp3) with the point p in the boundary dD does not hold, 
even in complex dimension one. Indeed, the function exp [e^^'^/^ / ^/w) is 

holomorphic in := {w E £- : Reu;> 0}, of class C°° on H and 
flat at w = 0. The restriction of this function to the Heisenberg sphere 
Ylew = zz of provides a CR example. 

To generalize rightly (ucp3), let M be a generic submanifold of codi- 
mension d ^ 1 and of CR dimension m ^ 1 in C", with n = m + d. Let 
S be a submanifold of M satisfying: 

Here, S plays the role of the point p in (ucp3). Denote by the union 
of CR orbits of points of S, i.e. the CR-invanant hull of S. It is an open 
subset of M. We say that a CR function / : M ^ C of class vanishes to 
infinite order along S if for every p G E, there exists an open neighborhood 
Up of p in M such that for every v eN, there exists a constant C > with 

|/i(t)| ^ C[dist(^,S)]^ teUp. 

Theorem 5.9. ( [|Rol986b[|BT1988ll , [*]) Assume that E is the intersection 
with M of some d-dimensional holomorphic submanifold of C". If a CR 
function of class vanishes to infinite order along S, then it vanishes 
identically on the globally minimal generic submanifold M. 

Assuming that S is only a conic rf-codimensional holomorphic subman- 
ifold entering a wedge to which all CR functions of M extend holomor- 
phically (Theorem 3.8(V)), the proof of this theorem may be easily gener- 
alized. 

Open question 5.10. ( [|Rol986bllBT1988l ) Is the above unique continua- 
tion true for S merely ? 

To attack this question, one should start with M being unit sphere C 
and E C S*^ being any T'^S''^-transversal real segment which is nowhere 
locally the boundary of a complex curve lying inside the ball. 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 1 1 1 



IV: Hilbert transform and Bishop's equation in 

Holder spaces 
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In complex and harmonic analysis, the spaces C^'" of fractionally differen- 
tiable maps, called Holder spaces, are very flexible to generate inequalities and 
they yield rather satisfactory norm estimates for almost all the classical singular 
integral operators, especially when < a < 1. For instance, the Cauchy integral 
of a C'" function / : F ^ C defined on a C"*"^'"^ Jordan curve F of the complex 
plane produces a sectionally holomorphic function, whose boundary values from 
one or the either side are C*'" on the curve. The Sokhotskii-Plemelj formulas 
show that the arithmetic mean of the two (in general different) boundary values at 
a point of the curve is given by the principal value of the Cauchy integral at that 
point. 

Harmonic and Fourier analysis on the unit disc A is of particular interest for 
geometric applications in Cauchy-Riemann geometry. According to a theorem 
due to Privalov, the Hilbert transform T is a bounded linear endomorphism of 
C'°(5A, M) with norm |||T|||^ ^ equivalent to ^f^^La) ' ^'^^ some absolute constant 
C > 0. This operator produces the harmonic conjugate Tn of any real-valued 
function u : OA ^ M on the unit circle, so that u + i Tu always extends holo- 
morphically to A. Bishop (1965), Hill-Taiani (1978), Boggess-Pitts (1985) and 
Tumanov (1990) formulated and solved a functional equation involving T in order 
to find small analytic discs with boundaries contained in a generic submanifold M 
of codimension (i in C". 

In a general setting, this Bishop-type equation is of the form: 

Uie^') = Uo-TmUi-),;s)] ie^'), 

where Uq G M*^ is a constant vector, where $ = ^{u,e^^ , s) is an M'^-valued 
f^K,a jjj^p^ ^jjj^ K ^ 1 and < a < 1, where u G M"', where e*^ e OA and 
where s G is an additional parameter which is useful in geometric applications. 
Under some explicit assumptions of smallness of Uq and of the first order jet of 
the general solution U = U (e*^, s, Uq) is of class C'" with respect to e*^ and 
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in addition, for every /3 with < /3 < a, it is of class C*'^ with respect to all the 
variables (e*^, s, Uo). These smoothness properties are optimal. 

1. Holder spaces: basic properties 

1.1. Background on Holder spaces. Let n e N with n ^ 1 and let x = 

(xi, . . . ,x„) € M". On the vector space M", we choose once for all the maxi- 
mum norm |x| := maxi^j^„ and, for any "radius" p satisfying < p ^ oo, 
we define the open cube := {x G M" : \x\ < p} as a fundamental, concrete 
open set. For p = oo, we identify with M". 

Let K G N and let a G M with ^ a ^ 1. If IC = R or C, a scalar function 
f : Op belongs to the Holder class C'^''^{n\'^,K) if, for every multiindex S = 

((5i, . . . , (5„) G N" of length \6\ ^ k, the partial derivative f^s{x) := is 
continuous in and if, moreover, the quantity: 

0^\d\^K P \d\=K ' P 

is finite (if a = 0, it is understood that the second sum is absent). In case / = 
(/i) • • • 1 fm) is a K^-valued mapping, with m ^ 1, we simply define ||/||^ ^ := 
maxi^j^m II/j IIk a- ^^^^ coherent with the choice of the maximum norm |y| := 
maxi^j^„ IYjI on K™. For short, such a map will be said to be C'^'"' -smooth or of 
class C^^" and we write / G C'''". One may verify ||/i/2|U,„ ^ • IIML,^ 

and of course ||Ai/i + A2/2||«.^„ ^ |Ai| ||/i||^^„ + |A2| ||/2lU,c^- If k = Oanda = 1, 
the map / is called LipscMzian. The condition |/(e^^")-/(e*^')| ^ ^-161" - e'\ 
on the unit circle was first introduced by Lipschitz in 1864 as sufficient for the 
pointwise convergence of Fourier series. 

Thanks to a uniform convergence argument, the space C'^'"(np,K) is shown 
to be complete, hence it constitutes a Banach algebra. The space of functions 
defined on the closure DJJ also constitutes a Banach algebra. If a is positive, 
thanks to a prolongation argument, one may verify that C'^'"(np,]K) identifies 
with the restriction C"'" (O^, 

Holder spaces may also be defined on arbitrary convex open subsets. More 
generally, on an arbitrary subset Q C M", it is reasonable to define the Holder 
norms || • || ^ „ , < a ^ 1 , only if disto (x" , x' ) ^ C • | x" — x' | for every two points 
x", x' G r2. This is the case for instance if is a domain in M" having piecewise 
C^'^ boundary. 

Introducing the total order ai) ^ (k, a) defined by: ki < k, or: ki = k 
and ai ^ a, we verify that C*'" is contained in C'^^'^^ and that: 

• ll/IL,o ^ \\fL,a for all a with < a ^ 1 and for all k G N; 

• ll/ILai ^ for all ai,a2 with < ai < 02 ^ 1 and for all 

K G N; 
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• ||/|U,i^||/|U+i,o.forallKGN. 

The first inequality above is trivial while the third follows from (1.3) below. We 

explain the factor 3 in the second inequality. Since |x" — x'|~"^ ^ |x" — x'p"^ 

only if |x" — x'l ^ 1, we may estimate: 

|/(x-0-/(xO| ^ |/(x-0-/(xO| ^„^„ 

sup ^ sup ^ \\f\^ . 

0<|x"-x'|<l r 0<|x"-x'|^l |X -X| 

On the other hand, if |x" — x'| > 1, we simply apply the (not fine) inequalities: 

l/(x")-/(x')l 



^^|/(x")-/(xO|^2||/|U^;2 



Consequently: 



0,0 ^ lU Il0,a2 ■ 



llo,ai = ll/llo,0 + sup ^ 3 ||/||o^„^ , 

x"^x' l-*^ I 



with a factor 3. For general k ^ 1, the desired inequality follows: 

\5\=K \5\=K 

^3||/lL,„,. 

In the sequel, sometimes, we might abbreviate C^'^ by C*, a standard notation. 
However, we shall never abbreviate C*^'" by C", in order to avoid the unpleasant 
ambiguity C^'*^ = = C°'^. Without providing proofs, let us state some funda- 
mental structural properties of Holder spaces. Some of them are in ||Krl983| . 

• The inclusions C^'^ C C"-" for (A, (5) > {k, a) are all strict. For instance, on 
M, the function XK,a = XK,a(x) equal to zero for x ^ and, for x ^ 0: 

'x''+°, if < a ^ 1, 

x'^/log X, if a = 0, 

is C^'" in any neighborhood of the origin, not better. 

• If < ai < a, any uniformly bounded set of functions in C^'" contains a 
sequence of functions that converges in C^'^^-norm to a function in C'"^ . This is 
a Holder-space version of the Arzela-Ascoli lemma. 

• For < a ^ 1, define the Holder semi-norm (notice the wide hat): 

x'Vx'GD^ |X - X I 

The constants satisfy ||c||g— = and, of course, we have ||/||o^„ = l/lo,o + l/lo';^- 
As a function of a, the semi-norm is logarithmically convex: 

Here, < ai < 02 ^ 1 and ^ t ^ 1. 
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• Importantly, if / is ]K"^ -valued, if 1 ^ / ^ m, from the Taylor integral 
formula: 

(1.2) fi (x") - fi (x') = /' f: §^ (x' + s(x" - x')) [x'Z - x^] ds, 

Jo .^^ OXi 



|/(x")-/(x')l= |/Kx")-/.(x')| 



follows the mean value inequality: 
(1.3) 

where x", x' G are arbitrary, and where 



^ll/llro-K'-x1 



This useful inequality also holds (by definition) if / is merely Lipschitzian, with 
II / II Q replaced by i/i^. 

• If a function / is C^'^, then for every multiindex 6 G N" of length \6\ ^ k, 
the partial derivative f^s is 0"-^^^'° and \\fAK~\5\,o ^ ll/IU,o- 

§2. Cauchy integral, Sokhotskii-Plemelj formulas and Hilbert 

transform 

2.1. Boundary behaviour of the Cauchy integral. Let Qbe a domain in C, let 
z G and let T be a -smooth simple closed curve surrounding z and oriented 
counterclockwise. Assume that its interior domain (to which z belongs) is entirely 
contained in 17. In case F is a circle, Cauchy ( IICal831i ) established in 1831 the 
celebrated representation formula: 



2vr« C ~ z 

valid for all functions / G 0{Q) holomorphic in Q. Remarkably, F may be 
modified and deformed without altering the value f{z) of the integral. 

The best proof of this formula is to derive it from the more general Cauchy- 
Green-Pompeiu formula, itself being an elementary consequence of the Green- 
Stokes formula, which is valid for functions / of class only defined on the 
closure of a domain C C having C^-smooth oriented boundary dQ ( IIHol973ll ): 

2vrz Jgn (- z 2Tn J Jq ( - z 

Indeed, for holomorphic /, one clearly sees that the "remainder" double integral 
disappears. 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



115 



The holomorphicity of the kernel enables then to build concisely the funda- 
mental properties of holomorphic functions from Cauchy's formula: local conver- 
gence of Taylor series, residue theorem, Cauchy uniform convergence theorem, 
maximum principle, etc. ( l|Hol973ll ). Studying the Cauchy integral for itself ap- 
peared therefore to be of interest and became a thoroughly investigated subject in 
the years 1910-1960, under the influence of Privalov. 

\i z ^ Q. belongs to the exterior of T, i.e. to the unbounded component of 
C\r, by a fundamental theorem also due to Cauchy, the integral vanishes: = 
2^ /r '^f-z'^ - Thus, fixing the countour P, as z moves toward T, the Cauchy 
integral is constant, either equal to f{z) or to 0. What happens when z hits the 
curve r ? 

Denote by a point of T and by A(Co, e) the open disc of radius e > centered 
at ^0- If Te denotes the complement r\A(^0) £)> introducing an arc of small circle 
contained in OA(Co, to join the two extreme points of F^, it may be verified that 

(2-2) TT / (Co) = lim 



2 " ^ 6^0 2TTi Jr^ C - Co 

Geometrically speaking, essentially one half of the circle dA{(o,e) of radius e 
centered at (q is contained in the domain U. Consequently, the "con^ect value" of 
the Cauchy integral at a point (q of the curve F is equal to the arithmetic mean: 

U lim + lim ) = i (/(Co) + 0) . 

Z \yZ—^(^o, z msidc z^Q), z outsidcy Z 

Let us recall briefly why the excision of an e-neighborhood of Co in the domain 
of integration is necessary to provide this "correct" average value. Parametriz- 
ing F by a real number, the problem of giving a sense to the singular integral 
Jp '^^9 ^'^^ amoun ts to the following classical definition of the notion of principal 
value ( ilMul953llGaT966llEK2000l ). 

2.3. Principal value integrals. Let a, 6 e M with a < b and let / be a C^- 

smooth real-valued function defined on the open segment (a, b). Pick x G M with 

a < X < b and consider the integral f whose integrand is singular. The two 

•J Q, y — X 

integrals avoiding the singularity from the left and from the right, namely: 
/ = log(ei) — log(x — a) and 

J a y-x 

/ = log(6 - x) - log(e2) 

Jx+ea y-x 

tend to —oo, as ei 0+, and to +oo as e2 — > 0+. Clearly, if 82 = £1 (or more 
generally, if ei and 82 both depend continuously on an auxiliary parameter e > 
with 1 = lim£^o+ ^7!^))' positive and the negative parts compensate, so that 
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the principal value: 



dy / \ , b- 

p.v. / := lim / + / =log — 



exists. Briefly, there is a key cancellation of infinite parts, thanks to the fact that 
the singular kernel ^ is odd. This is why in (2.2) above, the integration was 
performed over the excised curve Fg. 

Generally, if : [a, 6] ^ M is a real- valued function the principal vaiue integral, 
defined by: 



5(y) dy 



p.v. / := lim / + 



r 

Ja y 

rb 



a J x+e 



dy + c/(x) p.v. / dy 

X 7a y-x 

dy + g{x) log ■ 



y — X X — a 

g(y)^g(x) 

1 „Q-1 



exists whenever the quotient ^ integrable. This is the case for instance 



if g is of class C^'° or of class C^'°^, with a > 0, since y" ^ dy < oo. More is 



true. 



Theorem 2.4. niMul9531 IVe 19621 |Dyl991i ISME19881 IEK2000II . [*]) Let g : 
[a, b] Rbe 0'^'°' -smooth, with k ^ and < a < 1. Then for every x E (a, b), 
the principal value integral 

9{y)dy 



G{x) := p.v. / 

J a 



exists. In every closed segment [a',b'] contained in {a,b), the func- 
tion G{x) becomes C'^''^-smooth and enjoys the norm inequality 
l|G'llc->-[a',b'] ^ a(i-a) Ibllc"." [a,fe]' Z'^'' ■^^me co?i.sto?rf C = C {k, a, b, a' , b'). If g 
together with its derivatives up to order k vanish at the two extreme points a and 
b, the function G{x) is C^'^^-smooth over [a, b] and enjoys the norm inequality 
iCIIc-'-Ia.b] ^ \\g\\c.,c.[^^i,Y for some constant C = C{k, a, b). 

Notice the presence of the (nonremovable) factor ^pz:^- 

2.5. General Cauchy integral. Beginning with works of Sokhotskii IISol873ll . 
of Harnack MHalSSSII and of Morera ||Mol889ll . the Cauchy integral transform: 

has been studied for itself, in the more general case where F is an arbitrary closed 
or non-closed curve in C and / is an arbitrary smooth complex-valued function 



F{z) :=— f 
2Tn Jy 
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defined on F, not necessarily holomorphic in a neighborhood of T (precise rig- 
orous assumptions will follow; historical account may be found in IIGal966ll ). 
In Sokhotskii's and in Hai^nack's works, the study of the boundary behaviour of 
the Cauchy integral was motivated by physical problems; its boundary properties 
find applications to mechanics, to hydrodynamics and to elasticity theory. Let us 
restitute briefly the connection to the notion of logarithmic potential ( IIMul953ll ). 

Assuming F and / : F ^ M to be real-valued and of class at least C^'^, pa- 
rametrize F by aix-length C = Ci^)^ denote r(s) := C{s) — z the radial vector 
from z to C('5)> denote r = r(s) = |r(s)| its euclidean norm, denote t(s) := ^ 
the unit tangent vector field to F and denote n(s) := ^ / |^| the unit normal 
vector field to F. Puting z = x + iy and decomposing the Cauchy transform 
F{z) = U {x, y) + iV{x, y) in real and imaginary parts, the two functions U and 
V are harmonic in C\F, since F is clearly holomorphic there. After elementary 
computations, one shows that U may be expressed under the form: 



cos(r, n) 



ds, 



which, physically, represents the potential of a double layer with moment-density 
X 

2tt- 



7^. Also, V may be expressed under the form: 



which, in the case where F consists of a finite number of closed Jordan curves, 
represents the potential of a single layer with moment-density 

2.6. The Sokhotskii-Plemelj formulas. Coming back to the mathematical study 
of the Cauchy integral, we shall assume that the curve F over which the integration 
is performed is a connected curve of finite length parametrized by arc length 

where a < b, where (^{s) is of class C*^"^^'" over the closed segment [a, 6], and 
where k ^ 0, < a < 1. Topologically, we shall assume that F = C[a,b] is 
either: 

• a Closed Jordan arc, namely : [a, 6] — > C is an embedding; 

• or a Jordan contour, namely : (a,6) — > C is an embedding, (^{a) = 
C{b), C extends as a C+i'^-smooth map on the quotient [a,b]/{a ~ b) 
and T = C[a, b] is diffeomorphic to a circle. 

Various more general assumptions can be made: F consists of a finite number 
of connected pieces, F is piecewise smooth (corners appear), F possesses certain 
cusps, F is only Lipschitz, the length of F is not finite, / is LP-integrable, / is 
L^, i.e. f £ LP(F) and /p |/(s + h) - /(s)|P ^ Cte \h\'^, f belongs to certain 
Sobolev spaces, /(C) dC is replaced by a measure d^{C,), etc., but we shall not 
review the theory {see IIMul953[|WT962llGal966l and especially |Dyl991[). 



118 



JOEL MERKER AND EGMONT PORTEN 



The natural orientation of the segment [a, b] induced by the order relation on 
M enables to orient the two semi-local sides of F in C: the region on the left 
to r will be called the positive side ("+"), while the region to the right will be 
called negative ("—")■ In the case where F is Jordan contour, we assume that F is 
oriented counterclockwise, so that the positive region coincides with the bounded 
component of C\F. 



Theorem 2.7. ( IIMul953[ IVeT962l IGal966l |Dyl991| [SME1988I lEKlOOOl . [*]) 



Let T be a C'^'^^''^ -smooth closed Jordan arc or Jordan contour in C and let f 
T ^ C be a C'^''^-smooth complex-valued function. 



(a) If F' is any closed portion of F having no ends in common with those of 
F, then for every C,i G F', the Cauchy transform F{z) := ^ Jp -^^P^^ 
possesses (a priori distinct) limits and F~{(i), when z tends to 
(^1 from the positive or from the negative side. 

(b) These two limits F'^ and F^ are of class C'"^ on F' with a norm estimate 
\\F^ |lcf=,Q(p/-) ^ '~^a{h-a)'' i/ic^^cr)' ^ome positive constant where 

c{K,T',n 

(c) Furthermore, ifoo'j^ and denote an upper and a lower open one-sided 
neighborhood F' in C, the two functions F^ : uj'^ C defined by: 



j F^{z) := F{z) if z G (j^, 

\f±(z):=F±(Ci) if ^ = CiGr', 

are of class C^'" in uj'j^ U F', with a similar norm estimate 

(d) Finally, at every point C,q of the curve F not coinciding with its ends, F'^ 
and F~ satisfy the two Sokhotskii-Plemelj formulas: 

F+(Co)-F"(Co)=/(Co), 
^[F+(C«) + F-(C„)]=p.v.^/^m,c. 
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Sometimes, F is called sectionnally holomorphic, as it is discontinuous across 
r. Its jump across F is provided by the first formula above, while the arithmetic 
mean is given by the value of the Cauchy (singular) integral at Co £ T. 

Morera's classical theorem ( ||Mol8891 ) states that if and F~ match up on the 
interior of F, then the Cauchy integral is holomorphic in C minus the endpoints of 
F. As is known ( ||Shl990i ). this theorem is also true for an arbitrary holomorphic 
function F G 0{C\T) which is not necessarily defined by a Cauchy integral. 

2.8. Less regular boundaries. The boundary behaviour of the Cauchy transform 
at the two extreme points 7(a) and 7(6) of a Jordan arc is studied in [iMul953l| . We 



refer to |Dyl991 1 for a survey presentation of the finest condition on F (namely, it 
to be a Carleson curve) which insures that the Cauchy integral exists and that the 
Sokhotskii-Plemelj formulas hold true, almost everywhere. Let us just mention 
what happens with the Cauchy integral F{z) in the limit case a = 0. 

If F is (only) C^'^, if / is (only) C°'°, then for Ci in the interior of F, the 
limit F~ (Ci) exists if and only if the limit F~^{Ci) exists ( l|Mul953l ). However, 
generically, none limit exists. 

A more useful statement, valid in the case a = 0, is as follows. Assume 
F to be C^^^'" with k ^ and let F' be a closed portion of the interior of F. 
Pai-ametrize F' by a C+^'O map (' : [a',b'] T'. Extend C' = C'{s) as a a 
embedding ('{s,e) defined on [a',b'] x (— eo,eo)> where eq > 0, with 
0) = C'{s) and with ('{s,e) in the positive side of F' for e > 0. The family 
of curves F^ := C'iW ^ b'] x {e}) foliates a strip thickening of F'. 

Theorem 2.9. ( IIMul953ll ) For every choice of a C^^^'^ extension ('{s,e), and 
every f G C'^'^{T,C), the difference from either side of the Cauchy transform 
F\yi — F\yi tends to /|r' in C^'^ norm e — > 0: 



lim sup 

se[a',b'] 



\F{C'is,e))-FiC'{s,-e))-fiC'is))\ 



K,0 



0. 



To conclude, we state a criterion, due to Hardy-Littlewood, which insures C^'"- 
smoothness of holomorphic functions up to the boundary. 



120 



JOEL MERKER AND EGMONT PORTEN 



Theorem 2.10. ( IIMul953[lGaT966l . [*]) Let T be a 0"+^^'^ -smooth Jordan con- 
tour, divinding the complex plane in two components 0"^ {bounded) and $7" {un- 
bounded). If f £ O(O^) satisfies the estimate \d^f{z)\ ^ C(l — \z\)^~'^, for 
some K G N, some a with < a < 1, and some positive constant C > 0, then f 
is of class C'" in the closure = U T. 

2.11. Functions and maps defined on the unit circle. In the sequel, ft will be 
the unit disc A:={CgC: |C|<1} having as boundary the unit circle dA := 
{C G C : Id = 1}. Consider a function f : dA ^ K, where K = M or C. 
Parametrizing dA hy ( = e*^ with G M, such an / will be considered as the 
function 

M 3 9< — > f{e'^) e K. 

For j G N, we shall write fgj := 

Let a satisfy < a ^ 1 and assume that / G C*^ ". We define its C^'" semi- 
norm (notice the wide hat) precisely by: 

Thanks to 27r-periodicity, supg/^g/ may be replaced by supo<|g//„5i/|^^. Accord- 
ing to the definition of §1.1, the function / is C^'" if the quantity 

\\fL,a-= Yl \\feA\o,o + \\fe4o:a<°^ 

is finite. Besides Holder spaces, we shall also consider the Lebesgue spaces 
L^{dA), with p G M satisfying 1 ^ p ^ oo. As dA is compact, the Holder 
inequahty entails the (strict) inclusions L°°(5A) C L^' (dA) C LP((9A) C 
Li(9A),for 1< p < p' < oo. 

2.12. Fourier series of Holder continuous functions. If / is at least of class 
on dA, let 

2vrz J OA C 
denote the k-th Fourier coefficient of /, where /c G Z. Given n G N, consider the 
n-th partial sum of the Fourier series of /: 



We remind that Dini's (elementary) criterion: 

|/(e^(^+*)) + /(e^(^-*)) -2/(e* 
t 



■ dt < oo 
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insures the pointwise convergence lim„^oo ^nf{e^^) = /(e*^). If / is C*^'" on 
dA, with < a ^ 1, the above integral obviously converges at every e*^ G OA, 
so that we may identify / with its (complete) Fourier series: 



In fact ( |Zyl959P ), if / G C^'" with k G N and ^ a ^ 1, then \fk\ ^ 
^ WfW^ for all k G Z\{0}. Also, if / G C^'", then ^^^^ \fk\' converges 

for c > 2^^p]-- 1913, Berstein proved absolute convergence of X^fcgz I A I f^'' 
a > 1/2. 

2.13. Three Cauchy transforms in the unit disc. In the case = A, our goal is 
to formulate Theorem 2.7 with more precision about the constant C{k, dQ). For 
7/ G (9A in the unit circle and / G C^'"(5A, C) with k > 0, < a < 1, as in 
§2.6, we define: 



C+/(r?):= lim ^ [ dC, 



C"/(7?):= lim -i, / /^dC 

The Sokhotskii-Plemelj formulas hold: /(r/) = C^fM — f{r]) and C^f{rj) = 
\ [C^ fir]) + C~/(r7)]. A theorem due to AleksandroMj enables to obtain a precise 
estimate of the C " norms of these Cauchy operators. To describe it, define: 

M'^ :={/GCO'"(aA,C):/o = o}. 

Then |H|q-^ is a norm on Mq, since only the constants c satisfy ||c||q-^ = 0. For 
p, g G M with < p, (/ < 1, recall the definition B{p,q) := x^"^ (1 — 



('5' ^ fix of the Euier beta function. 



Theorem 2.14. ( IIA11975II ) The operator Cf{ri) := p.v. fg^ ^ dC is a 
bounded linear endomorphism of having norm: 



One may easily verify the two equivalences 5 (f , ^"2^) ~ § as a — > and 
B ^-^) ~ as a —> 1 as well as the two inequalities: 



1 ^ ( a I - a\ 4 



a{l-a) V2 ' 2 J a[l - a) 



^We are grateful to Burglind Joricke who provided the reference IIA11975I . 
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Thus, the nonremovable factor shows what is the precise rate of explosion 

of the norm III C'' III ^ as a ^ or as a ^ 1. 

Ill IIIO,a 

Further, if / G C'''" does not necessarily belong to Mq, it is elementary to 
check that ||C*^/||pQ ^ ^ ll/lloa' ^'^^ some absolute constant C > 0. It follows 
that the (complete) operator norm |||C°|||g ^ behaves like 

In conclusion, thanks to the Sokhotskii-Plemelj formulas C"*"/ = ^{C^f + f) 
and C~/ = ^{C^f — /), we deduce that there exists an absolute constant Ci > 1 
such that: 

^/^i <|||C^||| < 



a(l - a) o,a _ Q,)' 

where < a < 1 and where b = — , 0, +. 

Next, what happens with / G C'", for k G N arbitrary ? For b = — , 0, +, the 
C*^ are bounded linear endomorphisms of C'" and similarly: 

Theorem 2.15. There exists an absolute constant Ci > 1 such that if k £N and 
<a< 1,/or b = -,0,+: 



a{l-a) a{l-a)' 

In other words, the constant Ci is independent of k. To deduce this theorem 
from the estimates with k = (with different absolute constant Ci) we proceed 
as follows, without exposing all the rigorous details. 

Inserting the Fourier series F(/, e*^) in the integrals defining C~, C^, and 
integrating termwise (an operation which may be justified), we get: 

k<0 



^ /(e j - -- 2^ /fce +^Jo + ^2^Jke , 

k<0 k>0 

C+f{e'') = fo + Y,fke' 



ikl 

Jk ^ 

k>0 



If K ^ 1, by differentiating termwise with respect to 9 these thr^ee Fourier repre- 
sentations of the C'^, we see that these operators commute with differentiation. 

Lemma 2.16. For every j G N with ^ j ^ k and for b = —,0,+, we have: 

c'(/„) = (cv)^. 

Dealing directly with the principal value definition of C^f, another proof of 
this lemma for C° would consist in integrating by parts, deducing afterwards that 
and C+ enjoy the same property, thanks to the Sokhotskii-Plemelj formulas. 
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To establish Theorem 2.15, we introduce another auxiliary C'" norm: 

which is equivalent to ||-||^ ^, thanks to the elementary inequalities ([*]): 

Notice that ||-||o„ = |HIoq- The next lemma applies to L = C~,C'^,C^ and to 
L = T, the Hilbert conjugation operator defined below. 

Lemma 2.17. ([*]) Let L be a bounded linear endomorphism of all the spaces 
C'*'"((?A,C) with K G N, < a < 1, which commutes with differentiations, 
namely L (/gj) = {\-f)gj,for j G N. Assume that there exist a contant Ci(a) > 1 
depending on a such that Ci(a)~^ ^ III '-Ho « ^ Ci(a). Then for every k £ N: 

ci(«)"'^iiiMii:,«^c'i(«), 

(1 + tt)-! Ci(a)-i ^ |||L|||,^„ ^ (1 + vr) C,{a). 
Proof. Indeed, if / G C'", we develope a chain of (in)equalities: 

I|L/IL,„^I|L/||:,„= ll(L/)^^llo,a= E l|L(/^'^)llo,a 

<Ci(a) ll/e^llo,a = Cl(«) ll/li:,a 

<(l + 7r)C7i(a) 

This yields the two maj orations. Minorations are obtained similarly. □ 

To conclude this paragraph, we state a Toeplitz type theorem about C^, which 
will be crucial in solving Bishop's equation with optimal loss of smoothness, as 
we will see in Section 3. A similar one holds about C~, assuming (j) G H°°{C\A) 
instead, where C is the Riemann sphere. 

Theorem 2.18. ( l|Tul994bi . [*]) There exists an absolute constant Ci > 1 such 
thatforallf e C^-", k G N, < a < 1, andall(p£ H°^(A) := C'(A)nL°°(A): 

l|c+(/^)IL,„^^(l^ll/IU. Ml^- 

Closely related to the Cauchy transform are the Schwarz and the Hilbert trans- 
forms. 

2.19. Schwarz transform on the unit disc. Let u G L^{dA, M) be real- valued. 
The Schwarz transform of u is the function of z G A defined by: 

S„(.) := i / U(C) f i±i) ^. 
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Thanks to the holomorphicity of the kernel, Su{z) is a holomorphic function of 
z G A. Decomposing it in real and imaginary parts: 

Su{z) = Pu{z, z) + iTu{z, z), 

we get the Poisson transform of u: 



Pu{z, z) :- 



1 
27ri 



OA 



n(C) Re 



Q + z\dC 



together with the Hilbert transform of u: 

1 



Tu{z, z) :- 



dA 



C-zJ c 
C + z\dC 



C-zJ c 



Thanks to the harmonicity of the two kernels, Pu and Tu are harmonic in A. The 
power series of Cu, of Pu and of Tu are given by: 



Su{z) = no + 2 ^ Ufc z'', 

k 



Pu{z, Z) = Ukz'' +Uo + Uk z^, 



fe<0 



fc>0 



Tti(z, z) 



U-Y^ukz^+Y^ukzA 

\ k<0 k>0 / 



where Uk is the k-th Fourier coefficient of u. These three series converge normally 
on compact subsets of A. 

2.20. Poisson transform on the unit disc. Let us first summarize the basic prop- 
erties of the Poisson transform ( ||Kal968[ DR2002I ). Setting z = re'^ with 
^ r < 1 and ( = e**, computing Re (|rf ) and switching the convolution 
integral, we obtain: 



Pu(r e* 



where 



27r 



Pr{t) :-- 



1 



1 — 2r cos t + r'^ 
is the Poisson summability kernel. It has three nice properties: 

• Pr >0 on d A for r < 1, 

• ^ X!^ Prit) = 1 for ^ r < 1, and: 

• lim^^i- Pr{t) = for every t £ [-vr, vr]\{0}. 

Consequently, Pr is an approximation of the Dirac measure (5i at 1 G dA. For 
this reason, the Poisson convolution integral possesses excellent boundary value 
properties. 
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Lemma 2.21. ( IIKal968[|DR2002ll ) Convergence in norm holds: 

(i) If u G Z/P with l^p<ooorp = oo and u is continuous, then 

\\m^^i~ * u — u\j^p = 0. 

(ii) Ifu G C*'" with k G N and ^ a ^ 1, including a = and a = 1, then 

lim^^i- \\Pr *u- u\\^^^ = 0. 

In C^'", the pointwise convergence lim^^x- Pr * u(e*^) — > u{e^^) follows ob- 
viously. However, in L^, from convergence in norm one may only deduce point- 
wise convergence almost everywhere for some sequence rk —>■ I which depends 
on the function. In L^, almost everywhere pointwise convergence was proved by 
Fatou in 1906. 

Theorem 2.22. ( IIFal906[ lKaT968l IDR2002ll ) lfu£ with 1 ^ p oo, then 
for almost every e*^ E c?A, we have: 

lim Pr*u{e'^) =u{e'%. 
1 — >i~ 

In summary, the Poisson transform Pn yields a harmonic extension to A of 
any function u G LP(9A, M) or u G ^'"(^A, M), with expected boundary value 
hQ/^{Pu) = n on 9A. 

2.23. Hilbert transform on the unit disc. Next, we survey the fundamental prop- 
erties of the Hilbert transform. Again, u is real-valued on (9A. Setting z = r e'^ 
with ^ r < 1 and ^ = e**, computing Im (^^) and switching the convolution 
integral, we obtain: 



Ju{re'^) = — r T,(t)u(e^(^-*))cit, 
2vr J-n 



where 

^ , , 2r sint 

Tr(t) := ^ 

^ ' 1 -2r cost + r^ 

is the Hilbert kernel. It is not a summability kernel, being positive and negative 

with norm tending to oo as r — > 1^; for this reason, the Hilbert transform 

does not enjoy the same nice boundary value properties as the Poisson transform: 

Holder classes are needed. 

Setting r = 1, the Poisson kernel Pi(t) vanishes identically and the Hilbert 

kernel tends to , = '^"'^Mo ■ Near t = 0, the function cot(i/2) behaves 

2—2 cost smt/2 ' \ / / 

like the function 2/t, having infinite L norm. For u G C°'°(5A,M), it may be 
verified that, as 2 ^ e*^ G dA, the Hilbert transform Ju{z) tends to 

^ ^ 2^ tan(t/2) 



1 r 

P-v. — J n(C)Im 



126 



JOEL MERKER AND EGMONT PORTEN 



Since Re(^) = for C = e^* G OA, we get Im {^) = I so that 
we may rewrite 



Setting Poti := 2^ fg^ u{C)f = So, the algebraic relation - J = J 
gives a fundamental relation between C" and T: 

2C° - Po = iT. 

From Theorem 2.15, we deduce (Pq is innocuous): 

Theorem 2.24. ( IIPril9161 IHiTal9781 IBol991[ IBER1999II . [*]) There exist an 
absolute constant Ci > 1 such that if k €N and < a < 1: 

'/^^ <lllT||| < 



a(l-a) ^''^ a(l-a) 

It follows that at the level of Fourier series, T transforms n(e*^) = Fii(e*^) 



\ fc<0 k>0 J 



Notice that (Tu)o = 0. In fact, this formula coincides with the series 
i (~ Ylk<o ^kz^ + I^fc>o UkZ^), written for z e*^, the hmit existing pro- 
vided < a < 1. 

By termwise differentiation of the above formula, 'T{uqj) = {Tujgj for ^ 
J ^ K, if li G C^'" (some integrations by parts in the singular integral defining Ju 
would yield a second proof of this property). 

The Poisson transform Pn of n € C"'" having boundary value hQ^{Pu) = u 
and the Schwarz transform being holomorphic in A, we see that the function 
u + i Tn on 9A extends holomoiphically to A as Su{z). So Ju on A is one of 
the Harmonic conjugates of u. In general, these conjugates ai"e defined up to a 
constant. The property (Tn)o = means that Tti(O) = 0. 

Lemma 2.25. The Hilbert transform Tu on d/S. is the boundary value on (9A of 
the unique harmonic conjugate in A of the harmonic Poisson extension Pu, that 
vanishes G A. 



For u G C'"(5A, M), u + i Tu extends holomorphically to A. 



Furthermore, T(Tu) = —u + uq. 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



127 



2.26. Hilbert transform in spaces. It is elementary to show that the study 
of the principal value integral p. v. ^ J^^ "tan(t/2)^ '^^ equivalent to the study 
of the same singular convolution operator, in which cot(t/2) is replaced by 2/t. 
Similarly, one may define the Hilbert transfonn on the real line: 



H/(x) :=p.v. / I^dy. 

7m y - X 



If / is on R and has compact support or satisfies \ f\ < oo, replacing 
/(y) in the numerator by [/(y) — /(x)] + /(x) and reasoning as in §2.3, one 
straightforwardly shows the existence of the above principal value. 

Privalov showed that H/(x) exists for almost every x € M if / G L^(M). A 
theorem due to M. Riesz states that the two Hilbert transforms H on the real line 
and T on the unit circle are bounded endomorphisms of L^, for 1 < p < cxd, 
namely if / G LP(M) and u G LP{dA), then: 

LP(R) ^ II /II LP (M) 9,nd l|Ttt||iP(aA) ^ II "II LP (a A) ' 



whith the same constant Cp (|Zyl959||, Chapters VII and XVI). In IIPil972ll . Zyg- 



mund's doctoral student Pichorides obtained the best value of the constant Cp'. 
for 1 < p ^ 2, Cp = tan^, while, by a duality argument, Cp = cot for 
2 ^ p < oo. The two elementary bounds tan ^ ^ for 1 < p ^ 2 and 
cot ^ ^ p for 2 ^ p < oo, yield: 
(2.27) 

p2 p2 

I|H/|Ilp(k) ^ -^—^ II/IIlp(M) and W^flLP^aA) ^ ll/llLP(aA) ' 

for 1 < p < oo. In L^, the Hilbert transform is unbounded but, according to a 
theorem due to KoLmogorov ( |Dy 1 99 1 1 IDR20021 ) . it sastisfies a weak inequality: 



m{H/(x) > a} 11/1^1, 

for every a G M with a > 0, where m is the Lebesgue measure and where C > 
is some absolute constant. 



2.28. Pointwise convergence of Fourier series. The boundedness of the Hilbert 
transform in has a long history, closely related to the problem of pointwise con- 
vergence of Fourier series. In 1913, before M. Riesz proved the estimates (2.27), 
using complex function theory and the Riesz-Fischer theorem, Luzin showed that 
H is bounded in and formulated the celebrated conjecture that Fourier series 
of functions converge pointwise almost everywhere. This "hypothetical theo- 
rem" was established by Carleson ( ||Cal9661 ) in 1966 and slightly later by Hunt 
( l|Hul966ll ) in LP for 1 < p < oo. A complete self-contained restitution of these 
results is available in IIDR2002I . Let us survey the main theorem. 
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The n-th partial sum of the Fourier series of a function / on dA is given by: 



where 



sin(n + l/2)t 



Dn{t) :-- 



sint/2 

is the Dirichlet kernel, having unbounded norm ~ ^logn. It is 

elementary to show that the behaviour of this convolution integral, as n — > cx), is 
equivalent to the behaviour of the integral: 

'"^ sin nt 



t 

Without loss of generality, / is assumed to be real-valued, so that the above inte- 
gral is the imaginary part of the Carleson integral: 

Ant 



Cn{f,e'") :=p.v. 



t 



In, chapters 4, 5, 6, 7, 8, 9 and 10 of IIDR2002II . the main proposition is to prove 
that the Carleson maximal sublinear operator: 



sup 

n.eN 



is bounded from to L^. The proof involves dyadic partitions, changes of fre- 
quency, microscopic Fourier analysis of /, choices of allowed pairs and seven ex- 
ceptional sets. By an elementary argument, one deduces that the maximal Fourier 
series sublinear operator: 



sup 

n6N 



is bounded from to L^. 



Theorem 2.29. ( IICal9661 lHuT966l IDR20021 ) If f e with 1 < p < oo, there 
exists an absolute constant C > 1 such that: 

r,4 



l|F-/ll„<C|j^ 
Then by a standard argument, lim„^oo ^nf{e^ 



II LP 



/(e*^) almost everywhere. 



2.30. Transition. Since the grounding article IIHiTal978ll . the nice behaviour of 
the Hilbert transform in the Holder classes (Theorem 2.24) is the main reason 
why Bishop analytic discs have been constructed in the category of C'" generic 
submanifolds of (llBPoT982llBPil985llTul990l [^1990} lBol99l"llBRT1994[ 
ITul994a[|Mel994[[T^pT996|lJol996[[BER1999ll ). Perhaps it is also interesting to 
construct Bishop analytic discs in the Sobolev classes. 
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§3. Solving a local parametrized Bishop equation with optimal 

loss of smoothness 

3.1. Analytic discs attached to a generic submanifold of C". As in Theo- 
rem 4.2(111), let M be a C'" local graphed generic submanifold of equation 

V = ^p{x, y, u), where Lp is defined for |a; + i y| < pi, \u\ < pi, for some pi > 
and where ip{0) = 0, dip{0) = and \ip\ < pi. 

Definition 3.2. An analytic disc is a map 

which is holomorphic in the unit disc A and at least C^'^ in A. It is attached to M 
if it sends dA into M. 

Thus, suppose that {Z {(^) , W {()) is attached to M and sufficiently small, 
namely \[X + iY]{e'^)\ < pi, \U{e^^)\ < pi and \V{e^^)\ < pi on OA, where 
Z(C) = X{C) + iY{C) and W{0 = U{C) + iViQ. Then cleai'ly, the disc sends 
dA to M if and only if 

for every e*^ G dA. Thanks to the Hilbert transform, we claim that we may 
express analytically the fact that the disc is attached to M. 

At first, in order to guarantee the applicability of the harmonic conjugation op- 
erator T, all our analytic discs will C^'" on A, with k G N and < a < 1. 
We let T act componentwise on maps U = {U^,...,U'^) G C'''"(9A, M"'), 
namely JU := {JU\ . . . ,JU^). We set ||T?7||^^^ := maxi<;,^rf l|Tf/'IL,„- 
With a slight change of notation, instead of PC/(0), we denote by PqU := 
2^ J^^ [/(e*^) d9 the value at the origin of the Poisson extension PU. Equiv- 

alently, PqU = Uq is the mean value of U on dA. Here is a summary of the most 
useful properties of T. 

Lemma 3.3. The W^-valued Hilbert transform T is a bounded linear endomor- 
phism o/C-'"(5A,M^) with ^ |||T|||^^^ ^ satisfying T(cst) = 

and 

J{JU) = -U+Pq u. 
In the sequel, we shall rather use the mild modification Ti of T defined by: 
TiC/(e*^) :=T^7(e^^)-T^7(l). 
In fact, Ti is uniquely determined by the normalizing condition Ti[/(1) = 0. 
Then Ti is also bounded: H'"^ . ^ |||Ti||L „ ^ — 7r^> also annihilates con- 
Slants: Ti(cst) = and 

Ti(Ti[/) = -[/ + [/(!). 
Furthermore, most importantly: 
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Lemma 3.4. IfU G C'^'idA, M^), then U{e'^) + i JiU{e'^) extends as a holo- 
morphic map A — > which is C'" in the closed disc A. 

To check that the extension is C'" in A, one may introduce the Poisson integral 
formula and apply Lemma 2.21 (ii). 

If yl = (Z, W) is an analytic disc attached to M, we set Uq := U (1) and Vq := 
V{1). Since W is holomorphic, necessarily V{e^^) = JiU{e^^) + Vq. Applying 
Ti to both sides, we get TiF(e*^) = -U{e'^) + Uq (the left and the right hand 
sides vanish at e*^ = 1). Applying Ti to y(e*^) = ip (X(e*^), y(e^^), C/(e^^)) 
above and reorganizing, we obtain that U satisfies a functional equatiorQ involving 
the Hilbert transform: 



(3.5) 



C/(e*^) = -Ti [^{Xi.),Yi.),Ui-))] (en + Uo. 



Here, the map U : dA M'^ is the unknown, whereas the holomorphic map 
Z = X + lY : dA and the constant vector Uo are given data. 

Conversely, given X + iY and Uq, assume that U G C^'" satisfies the 
above functional equation. Set F(e*^) := Ti{7(e*^) + Vq, where Vq '•= 
ip{X{l),Y{l),U{l)). Then [/(e^^) + i y(e*^) extends as a C'" map A 9 C ^ 
W{C) e which is holomorphic in A. If |[X + iy](e*^)| < pi, \U{e''')\ < pi 
and |F(e*^)| < pi, the disc A := (Z, W) is attached to M. 

Bishop (1965) in the C^'" classes and then Hill-Taiani (1978), Boggess-Pitts 
(1985) in the Holder classes C'" established existence and uniqueness of the 
solution U to the fundamental functional equation (3.5). 

Theorem 3.6. ( IIBil9651 IHiTal9781 IBPil985ll ) // M is at least C^'", shrinking 
pi if necessary, there exists p2 with < P2 < Pi such that whenever the data 
Z £ CO'"(A,C™) n ©(A.C™) and Uq £ R'^ satisfy \Z{e'^)\ < p2 on dA and 
\Uq\ < P2, there exists a unique solution U G C'''^((9A, M"^), < /3 < a^, to the 
Bishop-type functional equation (3.5) above such that |C/(e*^)| < pi on dA and 
such that in addition \ V{e^^)\ < pi on dA, where 

V{e^') := J,U{e^') + <^(X(1), Y{1), [/(!)). 

Consequently, the disc {Z, U + iV) is attached to M. 



^The origin of this equation may be found in the seminal article lIBi 196511 of Bishop. 
Since then, it has been further exploited in IIPil974al IPi 1974b ' 'HiTal978: 'BeFol978| 
Wel982||BGT983llBPol98"2i rKW1982, R 1 9831 iHTMgMl lKW 1984, BPil985, FR19851 



Trpl986| 'Fol986 Tul988, Ail989, Tul990 1^19901 'Bol991 DH1992, Tul994i 



Tul994bllBRT1994 CR 1 994, iGl 1 994uMe 1 994riHuKr 1 995n Jo 1 995. |Trp 1 996, ,Tu 1 996) 



Jo 19961 IJ6 19971 |Mel997, Pol 9971 IMP1998I ITu 19981 IHu 19981 ICR1998I IJol999al 



J61999b MP1999 BER1999, Po2000, MP20()0l ITuSOOTl IDa200l1 IDS2001I IMe2002l 
MP2002. ,HM2002. ,Po2003. , JS2004. ,Me2004cJ . 
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Notice the (substantial) loss of smoothness, occuring also in HBRT 19941 
IBER19991 . which is due to an application of a general implicit function theo- 
rem in Banach spaces. The main theorem of this chapter ( IITul9901 ITu 199611 ) 
refines the preceding result with a negligible loss of smoothness, provided the 
graphing map 99 belongs to the Holder space C^'". In the geometric applications 
(Parts V and VI), it is advantageous to be able to solve a Bishop equation like (3.5) 
which involves supplementary parameters. Thus, instead of 99, we shall consider 
an M'^-valued C'" map $ = $(m, e* ^, s), where s is a pai^ameter. For fixed s, we 
shall denote by $1^ the map D^^ x dA B (u,e*^) 1 — > $ {u,e''^,s) G M"*. In 
accordance with Section 1, we set: 



||$„||nn := max > 




-«iio,o-,— I ll-«,llo,o 



and similarly ||^>0||o,o = ^^^if^fid i^eio.o- 

Theorem 3.7. (' IITul990[ lTuT996l . [*]) Let ^ = ^ {u,e^'^,s) be an W^-valued 



map of class C'", K^l, 0<a<l, defined for u G W^, \u\ < pi, ^ G M and 
s G M^ |s| < cTi, where < pi < 1 and < cJi < 1. Assume that on its domain 
of definition x 5 A x D^^, the map $ and its derivatives with respect to u and 
to 9 satisfy the inequalities {nothing is required about ^g)'- 

ll^llo,0 ^ Ci, ||^>„||o^o ^ C2, ||^>e||o,o ^ C3, 
for some small positive constants Ci, C2 and C3 such that 



(3.8) ci^Capi, cs^C^a^ 



1+ sup 

\s\<(n 



C3 ^ /3?C2, 



where {) < C < 1 is an absolute constant. Then for every fixed Uq satisfying 
\Uo\ < Pi/ 16 and every fixed s G D^j, the parameterized local Bishop-type 
functional equation: 



[/(e*^) = -Ti [^{U{-),;s)]{e'') + Uo 



has a unique solution: 

OA 3 e'^ ^ U{e'^,s,Uo) G 

with \\U\\q q ^ Pi/4 which is of class C^'" on dA. Furthermore, this solution is 
of class = Pl^^^ C^'^ with respect to all the variables, including param- 

eters, namely the complete map 

4 X Wl^/,, 



dA X X .6 3 U',sM ^ U{e^',s,Uo) G 



isC^ 



K,a—0 
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Since the assumptions involve only the C^'" norm of we notice that the 
theorem is also true with <J> G C'^'""'^, provided k ^ 2, except that the solution will 
only be C'^'""'' with respect to e* ^: it suffices to apply the theorem by considering 
that ^ G C'^, with P < a ai^bitrary, getting a solution that is C'^'^"^ with respect 
to all variables and concluding from n/3<o C'^'^~° = C^'"~'^. 

The main purpose of this section is to provide a thorough proof of the theorem. 
In the sequel, C, Ci, C2, C3 and C4 will denote positive absolute constants. We 
may assure that they all will be ^ 10^^ and ^ 10^. 

The smallness of ||$||q q, of ||$m||o ^i^d of W^eWo guarantee the smallness of 
11^ I'* 111 a/2 virtue of an elementary observation. 

Lemma 3.9. ([*]) Let x G DJJ, n G N, n ^ 1, where < pj ^ 00, and let 
f = /(x) be C^'" function with values in M°', d ^ 1. ^||/||oo ^ c, for some 
quantity c > 0, then: 



"0,a/2 



2 + 



"0,0 



We apply this inequality to ^u\s and to $6»|s> pointing out that for any (3 with 
< /3 ^ a, by definition: 

/ d 



\\^u\ 



"0,13 



max 



E 



max 



v,=i \{u»,e»)-{n',d>)\'' 




\iu",e") - {u',e')f 

Lemma 3.10. ([*]) Independently of s, we have: 





0^0/2 




1/2 
C2 


_2 + II^MIm 


5 










2 + II^MIi,„ 




11^1^ 


l,«/2 




/ 1/2 
Ci + C2 + C3 + ( 



+ c 



1/2 



2 + ||$| 



The presence of the squares in the inequalities of Theorem 3.7 anticipates the roots 

1/2 1/2 

C2 and C3 above. These two lemmas and the next involve dry computations 
with Holder norms. The detailed proofs are postponed to Section 4. 

Lemma 3.1L ([*]) IfU G C^'^{dA,R'^) with < /3 ^ a satisfies \U{e'^)\ < pi 
on (9 A, then for every fixed s G , we have: 



MU{-), •, ^ ll^llo.o + ll^e|lo,o + 11^6 

+ ll^«llo,0 l|f^lll,/3 + ll^«U 



0^ 









l + (ll 




+ 



l|c^llro + 



1+/3' 



1,0, 
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Remind ||C^||fo ~ ^^Pe We{e^^)\- We then introduce the map: 

U ^ m) ■■= Uo - Ti [«>([/(•), •, s)] {e''). 

To construct the solution U, we endeavour a Picard iteration process, setting 

Uk\k=o ■■= Uo with \Uo\ < pi/16 and Uk+i := d{Uk), for ken, when- 
ever ^{Uk) may be defined, i.e. whenever ||C/fc|loo ^ P^- shall first work 
in C^'°/2 c C'''". 

Lemma 3.12. If we choose the absolute constant C < 1 appearing in the theorem 
sufficiently small, then independently of s, the sequence Uk satisfies the uniform 
boundedness estimate: 

\\Uk\\i^a/2 ^ < Pi, 

hence it is defined for every ken and each Uk belongs to Ci'"/2(aA). 

Proof. By Theorem 2.24, there exists an absolute constant Ci > 1 (not exactly 
the same), such that 

ll|Ti||li,a/2 ^ Ci/a. 
Majorating by means of the C°'"/^-norm: 

ll^(f^A:)IIW2 ^ |f^0| + |||Tl|||i,„/2 ||<&(C/fc(-),-,s)llci-/2(9A). 

Assume by induction that Uk is C^'°/^ and satisfies \Uk\i ^ Pi/^ (this holds 
for k = 0). Clearly Uk+i = ^{Uk) is C^'^/^. Thanks to Lemma 3.11, and to the 
trivial majoration {\Uk\\^X''^ ^ < 1: 

\\HUk{-), ■, s)||ciW2(9A) ^ ll^llo.o + ll^e|lo,o + 2 ll^eUllo;^ + 

+ i'^'-io.O \\Uk\\l,a/2 + 2 W^ulsW^ \\Uk\\i,a/2 ■ 

Using then the assumptions (3.8) of the theorem together with Lemma 3.10: 

ll^fc+illi,Q/2 ^ + Ci a^^ 



Ci+C3 + 4C^/' (l + ||«>i,ii,^ 



+ \\Ukh,^/2 (c2 + 4cf (l + ||<I>Mli„ 

Using the two trivial majorations C3 ^ Capi and C2 ^ Ca together with the main 

1/2 1/2 

assumptions (3.8) to majorate C2 and Cg , we get: 

\\Uk+ih^^/2 < Pi/16 + C1P16C + \\Ukh^^/2 Ci 5 C. 

Choosing C ^ leciG (whence C ^ 2Ci5 ^' finally get: 

||C/fc+i|li,„/2^Pi/8+(l/2) ||C/fc||i,„/2. 

By immediate induction, the assumption \ Uo\ < pi/16 and these (strict) inequal- 
ities entail that || Uk \\ 1 a/2 ^ Pi fo^" every A; G N, as claimed. □ 
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Lemma 3.13. ( BTu 199011 . [*]) For every (3 with < (3 ^ a and every fixed 
s £ nj;^, if two maps W € Ci'°(5A, M'^) with ||C/^'||oo < pi/3forj = 1,2 are 
given, the following inequality holds: 

\\HU\-),;s) - «'(f/'(-),-,5)||co,,(aA) ^ C \\U^ - 

where 



llco>/3(9A) 



c 



l + (ll^' 



li,o 



+ ^ 



1 1,0 



Again, the (latexnically lengthy) proof is postponed to Section 4. 

Lemma 3.14. If we choose the absolute constant C of the theorem sufficiently 
small, then independently of s, the map: 

U^m) ■■=Uo-Ti mU{-),;s)] 
restricted to the set of those U G C^'"/^(5A, M*^) that satisfy ||f/||i.Q/2 < Pi/^, « 



a contraction: 



\\d{u')-d{u')l 



a/2 ^ 2 



0,a/2 • 



Proof Let W G C^'^/^ with ||C/^'||i„/2 ^ P^/^ ^'^^ ^ = ^'2- I" particular, 
q < pi/3, so Lemma 3.13 applies. In the majorations below, to pass to the 
fourth line, we use the assumption pi < 1, which enables us to majorate simply 
by 3 the three terms in the brackets of the third line: 

^ll|Ti||loW2 \\^iU\-),;s)-'^{uH-)r,s)l^^^, 



\0,a/2 



Ci 

a " '\'h,a/2 

C2 



1+ \\u' 



\l,a/2 



a/2 



+ u' 



\l,a/2 



a/2 



0,a/2 



Q, II I* II 1, a/2 II 110,0/2 



a/2' 



where C2 > 1 is absolute. Then we apply Lemma 3.10 to majorate 

we use the three trivial majorations 01,02,03 ^ Ca and we majorate 03^^ , o^^^ by 

1/2 

means of (3.8), dropping pi < 1 in O3 , which yields: 

-1/2 ^ l/2\ 



ll$l 



2 + k> 



1^1 



1,0 



ll,a/2 ^ Ci + 02 + 03 + (^02' + O3 

i^3Ca + 2Ca + 4Ca = 9Ca. 
Then we conclude that 

\\m')-m')l,a/2<CCs\\U'-U\^^^. 

Choosing the absolute constant C of the theorem ^ yields the desired con 
tracting factor i. 



□ 
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The fixed point tlieorem tlien entails that our sequence Uk converges in C^'°'/'^- 
norm towards some map U G C°'"/2(5A, R'^). More is true: 

Lemma 3.15. For every fixed parameters (s, U^), this solution 
U = U{e'^,s,Uo) = linifc^oo Uk belongs in fact to C^^°'/^{dA,R'^) and 
satisfies ||C/||i^a/2 ^ Pi/4. 

Proof. Indeed, since ||f^fc|liQ/2 ^ Pi/4 is bounded, it is possible thanks to the 
Arzela-Ascoli lemma to extract some subsequence converging in C^'^{dA) to a 
map, still denoted by f7 = [/ (e*^, s, Uq), which is C^'^ on dA. Still denoting by 
Uk such a subsequence, we observe that the uniform convergence \\Uk — U\\-^^ ^ ^ 
plus the boundedness \\Uk\\ ■^^'^ ^ Pi /4 entail immediately that the following 
majoration holds: 

\Ue{e^'") - Ue{e^'')\ ^. \Uk,B{e''") - UkAe''')\ ^ Pi 

iim < 



for arbitrary < \9" — 6'\ ^ vr. Consequently, U belongs to C^'"/^. Passing to 
the limit in \\Uk\\i a/2 ^ Pi/^' we also deduce \\U\\^ ^ pi/4. □ 

The next crucial step is to study the regularity of the solution 

U = U (e*^, s, C/o) with respect to (s, C/q)- 

Lemma 3.16. The solution U = C/(e*^, s, Uq) satisfies a Lipschitz condition with 
respect to the parameters s and Uq. 

Proof. Consider two parameters s^,s^ G D^^ and define := [/(e*^, s-', [/q) 
for j = 1,2. Then substract the two corresponding Bishop equations, insert two 
innocuous opposite terms and majorate: 

P'-U\a/, ^ \mo,./2 [\\'^{uH-)r,s')-^{U\-),;s')l^^^^ + 

To majorate the difference in the second line, we again apply Lemma 3.13. To 
majorate the difference in the first line, we apply: 

Lemma 3.17. ([*]) Let (3 with < /3 a, let U £ C^'°{dA,R'^) with \\U\\q^q < 
pi and let two parameters s^, G . Then 



l,/3 







l + (ll 


^ii7o) 
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With (3 := f , we thus obtain: 



I ll0,a/2 ^ a 



l^lll,0 + ll^lll,a/2 



+ sup 

|s|<tri 



■ l*lll,a/2 



1+ \\u^ 



li,o 



1+ P7 



ll,0 



+ 



Then we apply the majoration of Lemma 3.10 to ||*^|s||x a/2 ^'^^ pi < 1 to 

majorate by 1 the terms If^-' llj-Q ^ Pi/^'- 



0,q/2 



^ CiQ^^ Is^ - s^l 3 ||^>| 



1,q/2 



0,a/2 



Setting K := Cia ^ 3 ||<l>||]^ ^^2' requiring C ^ 2^ ^^^^ reorganizing we obtain 
that J7(e*^, s, Uq) is Lipschitzian with respect to s: 



0,a/2 



^ 2K _ gll 



The proof that C/(e*^, s, C/q) is Lipschitzian with respect to Uq is similar- and even 
simpler. □ 

In summary, the solution U = U{e^^ , s, Uq) is C^'"/^ with respect to e*^ and 
Lipschitzian with respect to all the variables (e*^, s, Uq). 

Consequently, according to a theorem due to Rademacher ( ||Ral919[|Fel969ll ). 
the partial derivatives Us^., k = 1, . . . ,b and C/^^, m = 1, . . . , d exist in L°°. We 
then have to differentiate the Bishop-type equation of Theorem 3.7 with respect 
to 9, to Sfc and to J/™. However, the linear operator Ti is not bounded in in 
fact, according to (2.27), |||T|||j^p ~ p as p ^ cxo. So we need more information. 

Lemma 3.18. There exists a null-measure subset ^ C x □'^ and there 

^1 pi/lD 

exists a quantity K > such that at every (s, Uq) 9X for every k = 1, . . . ,b and 
for every m = 1, . . . ,d: 

(i) the partial derivatives Us,, (e* ^,s,Uo) and Uu^{e^^ , s^Uq) exist for every 

(ii) the maps e*^ ^ ^^sje*^ s, C/q) e*^ ^ Uu^{e'^ , s, Uq) are C°'"/2 
on dA and satisfy the uniform inequality 

\\Usk{-,s,Uo)\\co,c/2(^Q^) and jUus^i', s,Uo)\\^o,o./2^q^) ^■ 



Proof. Since U is almost everywhere differentiable with respect to all its argu- 
ments, there exist a subset ^ C O'^^^ x Dp^/ig ^ having full measure, namely 
its complement has null measure, such that for every (e*^, s, Uq) G ^, all partial 
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derivatives Ue, Ug^., Uu^ exist at (e*^, s, Uq). Since 5^ has full measure, there ex- 
ists a 
slice 



ists a null measure subset 91 C D^^ x Dp^/ig ^^^^ ^^^^ ^'^^ every (s, Uq) 91, the 



:= (aA X {s} X {;7o}) n 5 

is a subset of 9A having full measure, so that f/e, C/s^., [/[/™ exist at (e*^, s, [/q) 
withe*^ G5«,c/o- 

Fix (s, ?7o) We will treat only the partial derivatives with respect to the 
Sfc, arguments being similar for the Ujjrn. In the end of the proof of Lemma 3.17, 
we have shown: 



l0,a/2 



for some (not the same) quantity K > 0. Fix k G {1,2,..., h}, take and 
with s\ 7^ s\ but sj = sj for / / A:. The inequality above says that for every 
e^^ e*^', e'^" € 9A with < \0" - O'l ^ vr, we have 



U{e'',s^Uo)-U{e'',s\Uo) 



+ 



+ 



Uie''",s^Uo)-U{e''",s\Uo) 



s2 - 



U{e^<^\s\Uo)-U{e^'\s\U^) 



9T/2 < K. 



Assume e*^, e*^', e*^" G [/g, let — > (the Umits of the quotients above 
exist) and rename by s: 



,s,Uo 



9'|"/2 



^ K. 



This inequality says that Us^{-, s, Uq) is C*^'"/^ almost everywhere on dA. The 
next extension lemma concludes the proof. □ 

Lemma 3.19. Let n ^ I, let x e M", let m ^ 1, let y G M™, /) > 0, Zf-? 
o" > 0, and let f = /(x, y) be a function defined (only) in a full-measure subset 
^ C Dp X n™, 5o f/iaf there exists a null-measure subset 91 C wjY/i 
property that for every y 91, f/je slice := (Dp x {y}) x ^ has full measure 
in Dp. Assume that for every y 91, every x, x', x" G i?y, we /lave 



l/(x,y)l + 



|/(x^y)-/(x^y)| 
Ix" - x'|/3 



for some /? w/f/; < /3 < 1 ant/ iome quantity K > 0. Then for every y 91, 
the function x /(x, y) admits a unique continuous prolongation to 5f/Z/ 
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denoted by /(•, y), that is C^'^ in with 

ll/(->y)llco^/3(nn) ^ K. 

Thus, for every (s,f7o) the partial derivatives Us,,, Uu^ belong to 
C°'"/^((9A, M'^). Since the operator Ti is hnear and bounded in C°'"/^, we may 
differentiate the d scalar Bishop-type equations of Theorem 3.7 with respect to 9, 
to Sk, k = 1, . . . ,b and to [7™, m = I, . . . ,d, which yields, for j = 1, . . . , d: 
(3.20) 



-Ti 



l<l<d 



^i^{U{-),;s)Ui^{-) + <^iJU{-),;s) 



l<l<d 



6^ 



for every e'^ G 5 A, provided {s,Uo) ^ 01. In the first line, we noticed that 
{'^iV)e = T(V9). We observe that as U is Lipschitzian, as <J> G C*'" and as 
K ^ 1, the composite functions ^u,,^g,^i. (^[/{e^^ , s,Uo),e^^ , are of class 
C^'° with respect to all variables. 

We notice that in each of the three linear systems of Bishop-type equa- 
tions (3.20) above, t := (s, Uq) is a parameter and there appeai^s the same matrix 
coefficients: 

piie'',t) ■.= ^i^ {uie'',s,Uo),e'',s] 
for j, Z = 1, . . . ,d. For any with < /3 ^ a, in order to be coherent with the 



definition of \\^u\ 



II given after Lemma 3.9, we set: 

ll^l*llo^-=™ E \\pi ' 



0,/3 



A<l<d 



We also set: 



110,0 •- 



max 

i^^d 



E ll^'illo.o 



11$ 



"110,0 



A<l<d 



With these definitions, it is easy to check the inequality: 



bMlo,/3 ^ W^uUl^p 1 + (l|t/|li,o 

ll^llio ^ /'i/^ < ^' ^^^^ 1^ '■~ we deduce: 

llpUL ^ 2 ||<I>„|J|n ^ 2 ||$L||i . 

ll-t^|i:|IO,a ^ II M IS NO, a ^ II 1^11 l.o 
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Taking sup^ and then sup(7g, adding 1, squaiing and inverting: 



1 + sup ||$| 



€ 4 



1 + sup \\p\t\\o^, 

s,Uo 



Consequently, the main assumption of the next Proposition 3.21, according to 
which: 

-2 



110,0 



1 + sup \\p\ 



*llo,( 



for some positive absolute constant C < 1, is superseded by one of the main 
assumptions, made in the theorem, according to which: 

-2 

1 + SUp ||^>|s||o, 



||$Jloo^C7V 



for some {a priori distinct) positive absolute constant C < 1. 

The following proposition applies to the three systems (3.20) and suffices to 
conclude the proof of Theorem 3.7 in the case k = I. The case k ^ 2 shall be 
discussed afterwards. 



Proposition 3.21. ( HTu 19961 . [*]) Let c £ N with c ^ 1, let 
Ti = (ri^i, . . . , Ti^c) G with < ri^,, ^ oo, i = l,...,c and denote 
by D^^ the polycube {t G M'^ : \ti\ < Ti^i}. Consider vector-valued and 
matrix-valued Holder data: 



P 



' Ji<i<d V 



with < a < 1. Suppose that a bounded measurable map: 



^x•'(e*^^)) G L°°{dA x □^^,M'^), 



IS every fixed t not belonging to some null-measure subset 91 

of D^^ and suppose that it satisfies the system of linear Bishop-type equations in 

C°'"/2(aA,M'^): 



(3.22) 

for j = 1, 
p satisfies: 



A<l<d 



, d, where T* = T or T,,, = Ti. Assume that the norm of the matrix 



llPllo,o= max I \\p>i\\^^^ I ^C4, 



140 



JOEL MERKER AND EGMONT PORTEN 



for some small positive constant C4 < 1/16 such that 

(3.23) C4 ^ c? 

where C < 1 is a positive absolute constant. Then, after a correction ofu on 

(i) on its full domain of definition 9A x D^^, the corrected map ti(e*^, t) is 
^0,Q-0 _ Plp^^^^ C^'f^ and furthermore: 

(ii) for every fixed t, the map e*^ ^ u{e^^,t) is C^'" on dA. 

In general, the Hilbert transform T does not preserve C°'" smoothness with 
respect to parameters, so that the above solution u = u{e^^,t) is not better than 

Example 3.24. ( IITul996i ) If s G M with |s| < 1 is a parameter, the function: 

M(e'^ s) := |sr if - vr ^ ^ ^ 

:= d^" if - |s|^/2 ^0^0, 

:= r if ^ ^ 

:= |s|" if |sK 6* ^ IT, 

is 27r-periodic with respect to 9 and C*^'" with respect to (e*^, s). As the function 
cot(t/2) — 2/t is C^'^ on [— vr, vr], the regularity properties of the singular integral 

Tu(e*^) = p.v. - "j^ dt are the same as those of: 

Tn(e*^) := p.v. - / ^-dt. 

However Tn(l) involves the term log \s\ which is C^'^-o but not C*^'": 

Tn(l) = - / ^-^dt+ ^JLdt+ —dt] 
yJ_|s|i/2 t J_|s| t Jo t J 

Proof of the proposition. We shall drop the indices, writing n, p and q, without 
arguments. Assume that t For future majorations, it is necessary to have 
Pqu = 0. If this is not the case, we set u' := u — Pqu in order that Pq u' = 0. 
Since u satisfies either u = T{pu) + q or u = T{pu) — T[pu\{l) + q, it follows 
that u' satisfies similar equations: either u' = J{pu') + q', with q' := q — Pqu or 
u' = T{pu') + q', with q' '■= q — Pqu — T{pu){l). Notice that p is unchanged. 
It then suffices to establish the improvements of smoothness (i) and (ii) for u'. 
Equivalently, we may assume that uq = Pq u = in the proposition. 



1 + sup WpltWo. 

\t\<ri 
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For t 91, the function (j) is C°'"/^ on dA. Applying T either to the equation 
u = J{pu) + g or to the equation u = T(pn) — T|j3M](l) + q, we get the same 
equation for both: 

Ju = —pu + Pq{pu) + Jq. 

As Mo = 0, we may write u{e^^) = J2k<o Sfc e*''^ + J2k>o e^^^ =: (j) + (j), 
where (j) extends holomorphically to A. In fact, 4> is determined up to a imaginary 
constant iA and we choose A := — Po(pn) /2, so that: 

. u + iJu-iPQ{pu) 
(3.25) = . 

Equivalently: 

[ Tu = Po(pu) - - 4)). 
Substituting, we rewrite (3.25) as: 

= -p(0 + ^) + Tg, 

or under the more convenient form: 

^ = ^ + P^ + Q, 

where the d x d-matrix P := —2ip{I + ip)~^ and the d-vector Q := i{I + 
ip)~^Jq both belong to C°'°. 

First of all, we establish (ii) before any correction of u. 

Lemma 3.26. For t 01, the map e*^ ^ u(e*^, t) is C°'" on dA. 

Proof. By assumption, the map e*^ ^ (j){e^^ ,t) is C*^'"/^ on dA. Since C"*" is 
bounded in C*^'"/^, we may apply to the vectorial equation (j) = (j)+P cj)+Q cf), 
noticing that C'^((/)) = (j) ^^'^ that C^{(l)) = Po since, by construction, (j) 
extends holomorphically to A. We thus get: 

(3.27) = Po^ + C+ [P^ + Q] . 

Remind that Pq = ^ Jl^ tpie^^) dO, so that ||Po V'lico ^ IIV'llo,o- Notic^^that 
^)llo Q < 'x> f-Ot t ^ ''yi. Taking the C'^'" norm to (3.27) and applying crucially 
Theorem 2.18 in its M''-valued version, as in ||Tul996l . we get: 

<ll</'llo,o + ^(^(lia,« ll'/'llo,o + IIQIIo,«) 
< oo, 



^ In Lemma 3.15 above, for i ^ Dl, the map e*^ i-^ u(e**, t) was shown to be C"'"/^ 
on OA in order to insure that Tit(-, t) and t) are both bounded on OA, so that Theo- 
rem 2.24 may be applied in the next phrase. In IITuI996ll . it(-, t) is only shown to be in 
L°°{dA), but then Tu{-,t) and 4> are not necessarily bounded. 
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whence (f) = 4>{-,t) is C*^'" on 5A, as claimed. □ 

Next, we shall establish (i) before any correction of u. To this aim, let t^^t^ 
91 and simply denote by v} ,u^, by (t^^^cj)^, by P^,P^ and by Q^,Q^ the functions 
on OA with these two values of t. In the theorem, to establish that u is C*^'""", it 
is natural to show that u is C°'^ for every j3 < a arbitrarily close to a. 

Lemma 3.28. For every (3 with ^ < (3 < a, every two t^,t^ 91, we have 
— li^'^llgQ ^ 4 Kq^^ — t^\^ , for some positive quantity Kq,^^ < cxo. 

We shall obtain Ka ^g involving a nonremovable factor l/{a — (5). This will 
confirm the optimality of C°'"~'^-smoothness of u with respect to the parameter t. 

Proof. Since P\)U= Po(Tu) = 0, applying Pq to the conjugate of (3.25), we get 
Pq = § Pq{pu), so that we may rewrite (3.27) under the form: 

</.= ^PoM + C+ [P^ + Q\. 
We may then organize the difference cfP' — 4^ as follows: 

- 0^ = ^ Po {p\u' - n')) + \ Po {{p" - p'W) + 

+ C+ ((P2 _ pl)^2 ^ ^2 _ Ql^ + c+ - 0^)) 

=: -El + -E'2 + -£'3 + E^. 
To majorate these four E'j's, we shall need various preliminaries. 
Firstly, to majorate Ei, we first observe the elementary inequality: 

(3.29) h'-^\o^^U"-^\o- 
Also, we notice that: 

ll^'lo.o = lb(-'*^)llco.o(aA) ^ \\P\\o,o ^ ^4- 
The maj oration of Ei is then easy: 

ll^l|lo,0^^ I|P'II0,0 lh'-^'llo,0^4^4||</''-<A'||o,o- 

Secondly, to majorate E2, let again /3 with ^ < /3 < a. Using the inequality 
i^'io /3 ^ ^ 11^*110 a proved iri the beginning of Section 1, we may majorate E2: 

ll^2|lo,0 ^ \ h\o \\P'-P\0 ^ I h\o IHIo,. \t'-t'f. 

Thirdly, to majorate E^, we need: 
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Lemma 3.30. Let f = /(x, y) be a C^'"' function, defined in the product open cube 
U^; X n^, where < a < 1 and p > 0. Let (3 with < (3 < a. For x' , x" £ H'^ 
arbitrary, the C^'°^~l^ -norm of the function 3 y i — > /(x",y) — /(x',y) € M 
satisfies: 

||/(x",.)-/(x',-)||o,„-^^4||/||o^Jx"-x'|^ 

Again, assume ^ < /3 < a. Thanks to Theorem 2.18 and to the lemma above, we 
may maj orate £^3: 

Fourthly, to majorate £^4, we need a statement whose proof is similar to that of 
Lemma 3. 10. 

Lemma 3.31. As \p\q q ^ ^4, then independently oft we have: 

2 + sup blilo 



II / , 1/2 

ll0,a/2 ^ C4 + C4 



2 

, whence C4 ^ 



Reminding the main assumption C4 ^ C^a^ 1 + sup^ ||p|t||o 
Ca, we deduce: 

b|Jlo,Q/2 ^ 3Ca. 

Choosing then C < 1/6, we may insure that ||p|J|o,o/2 ^1/2 for every fixed t. It 
follows in particular that we may develope P = —2ip XlfceN {—w)^ and deduce 
the norm inequality: 

II „ II , 2 ||p|J|o,c./2 . . II II 

valid for every fixed t. Then again thanks to Theorem 2.18 and thanks to the 
previous inequalities: 

ll-^4|lo,0 ^ ll^4|lo,a/2 ^ CiU'^ \P^\\o,a/2 W ~ <^NIo,0 
^ C2a^^ \\p\tA\o,a/2 W ~ ^^\ofi 
^ C3C Ic/)^ - (^^Iq^q 

provided C < j^. We then insert these four majorations in the inequality 

W - ^ ll^lio,0 + ll^2|lo,0 + ll^3|lo,0 + ll^4|lo,0 ' 

and we get after reorganization: 

.11/3 
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for some quantity Kq, ,g < oo whose precise expression is: 
C / \ 3 

:= [\\P\\o,a Iklo.O + ) + ^ i^^ llo,0 mO,a ' 



It suffices then to remind that C4 < 1/16 in the assumptions of the theorem to 
insure the uniform Holder condition: 

valid for t^,t'^ m. From (3.29), we conclude that ||ii^-u^||oo ^ 
4 ^a,f3 \t'^ — The proof of Lemma 3.28 is complete. □ 

Then the correction of u is provided by the following statement. 

Lemma 3.32. ([*]) Let f = /(x,y) : D^J x -^Rbea measurable L°° 

map defined only for y not belonging to some null-measure subset 91 C and 
let /3 with < /3 < a. If the map x ^ f(x, y) is C^'^ for every y 91 and if there 
exists K < 00 such that: 

sup |/(x,y2)-/(x,yi)UK|y2-yY, 



for every two y^, y^ 91, then f may be extended as a C^'^ map in the full domain 

In sum, still denoting by u the C*^'""*^ extension of u through 91, property (i) of 
the proposition is proved. To obtain that u is C*^ " with respect to e*^, we re-apply 
the reasoning of Lemma 3.26 to this extension. 

The proof of Proposition 3.21 is complete. □ 

In conclusion, the functions Ug, Ul^ and C/^^m ai^e C*^'""*^ with respect to 
(e*^, s, Uq) and C"'*^ with respect to e*^. Thus, the theorem is achieved if k = 1. 

If K = 2, the composite functions ^i- ([/(e*^, s, Uq), e*^, s) are then 

of class with respect to (e*^, s, Uq) and of class C^'" with respect to e*^. 

We then apply the next lemma to the three families of Bishop-type vector equa- 
tions (3.20). 

Lemma 3.33. Let t G be a parameter with c G N, < ri^j ^ 

00, i = 1, . . . ,c, and consider vector-valued and matrix-valued Holder data 

q = (qi{e'^,t)y^^^'^ and p = fW(e^^ t)) ^^^^'^ that are C^'^^^ with re- 

spect to (e*^,t) and C^'" with respect to e*^. Suppose that a given map u = 
(u-' (e*^, t))^^''^ which is 0^'°'^'^ with respect to (e*^, t) and C*^'" with respect to 
e* ^ satisfies the linear Bishop-type equation u = T^, (pu) + q, where T^, = T 
or T^, = Ti. Assume that the norm of the matrix p satisfies the same in- 
equality as in the proposition: \p\qq ^ C4, for some small positive constant 
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r 1 ~^ 

C4 ^ 1 + sup^ l|p|i|lo a ' where Q < C < 1 is some absolute constant. 

Then u is C^'" with respect to e*^ and satisfies the Lipschitz condition 

for some quantity K < oo. Furthermore, there exists a null-measure subset C 
|— X Dpj/xg such that at every t OT, for every I = 1, . . . , c: 

(i) the partial derivative ut^ (e*^, t) exists for every e'^ G dA; 

(ii) the map e}^ ^ ut, {e'^,t) is C"'"/^ on OA. 

Proof. The fact that u is C^'" with respect to e*^ is proved as in Lemma 3.26. 
For the Lipschitz condition, the reasoning is simpler than Lemma 3.17, due to the 
linearity of u = J^{pu) + q. Indeed, for two parameters t^, G D^^, if we take 
the C*^'"/^-norm of the difference: 



we get: 



2 ^Cia-l 11/11 _^l|| j^K2 .1 



\u — u 



l0,a/2 ^ ^-L" 11^ \\0,a/2 ir \\0,a/2 

and after substraction, taking account of Lemma 3.31: 

II 110, a/2 ^ I I 

Then the sequel of the reasoning is already known. □ 

So for I = 1, . . . , c, the partial derivatives ut^ exist almost everywhere and they 
satisfy: 

with the same matrix p, where qi := T^,(pjju) + qt^ is C*^'""" with respect to 
(e*^, t) and C°'° with respect to e*^. 

Lemma 3.34. Proposition 3.21 holds true if more generally, q is only assumed 
to be ^jY/j respect to (e*^,t) and C"'" with respect to e*^, with the same 

conclusion. 

(It suffices only to inspect the majoration of E-^.) Consequently, with u = 
Ug, Us^ , C/t/™ in the three equations (3.20), we have verified that the partial deriva- 
tives uq, Usf. and uijm exist everywhere, are C*^'""*^ with respect to (e* ^, s, Uq) and 
are C^'"' with respect to e*^. In summary, the theorem is achieved if k = 2. 

Needless to say, we have clarified how to cover the case of general k ^ 2 by 
pure logical induction. In conclusion, the proof of Theorem 3.7 is complete. 

Open problem 3.35. Solve parametrized Bishop-type equations in Sobolev 
spaces. 
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54. Appendix: proofs of some lemmas 



4.1. Proofs of Lemmas 3.9 and 3.10. Let x G M", n ^ 1, with |x| < p, where 
< /9 ^ oo. Assuming ||/||o o ^ c, we estimate: 

' x"ftx' |X — X I 

where A := suPq^|^„„^,|^^i/q and B := sup|y,_y|^^i/a satisfy: 



A = sup 

0<|x"-x'|<cVo 



I/(X")-/(X')I I . na/2\ _ 
X — X 1 ^ 



x" — x' 



Il0,a 



-1/2 



B 



sup 



|/(x")-/(xO| ^ 2| 



110,0 



-1/2 



^ 2c 



1/2 



2 + 11^6 



0,a 



0,a 



^ C 



1/2 



^ C 



1/2 



2 + II^MIi,. 



|x"-x'|^cV^ |x"-x'|"/2 

Lemma 3.9 is proved. 

Applying this to x = (n, 6), we deduce: 

Consequently: 

II^MIw2 = ll^l«io,o + ll^-Ullo,o + ll^eMIco + ll^«Ullo;^+ i^eMlow2 

^ Ci + C2 + C3 + (4/' + 4/') [2 + ||$||,^ 

Lemma 3.10 is proved. 



□ 



□ 



4.2. Proof of Lemma 3.11. We shall abbreviate supQ<|g//„0/|^^ by supgn-^gi. By 
definition: 



l^(f^(-),-,^)|lci„'3(9A) = 
= sup \^{U{e''^),e'^,s) 



+ 



+ 



+ sup| ^^,{U{e^''\e^'\s)uUe^''') + MU{e''l,e^''',s)- 



l<l<d 
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Majoiating and inserting some appropriate new terms whose sum is zero: 

<ll^llo,o + ll'^«llo,o l|f^lli7o + ll^e|lo,o + 

+ sup\Y: <^uMe''"),e''",s)[uUe^'")-UUe^'')y 



+ sup| ^ K{U{e^'>''),e^'\s)-^u,{U{e^''),e^rs)]ui>{e^'') 

Q11-J.01 I — ' L J 



l<l<d 



+ sup \MU{e''"),e''",s)-MUie''"),e'rs) 



+ 



+ sup 



Maj orating: 

<ll^llo,o + ll'^«llo,ollf^llCo + i^eio,o + 

+ msi-^ + ms\\s:^{\\u\\^,f, 

which yields the lemma, noticing that ||^n|lo ( ll^iro + H^Hf^) ^ 

ll^n|lo,oll^lll,/3- ' ' ' □ 

4.3. Proof of Lemma 3.13. We need two preparatory lemmas. 

Lemma 4.4. Let n ^ 1, let x £ R"-, let m ^ 1, let y G M™, let p > and let 

f = /(x, y) be a £ C^'" map, with < a ^ 1, defined in the strip {(x, y) G 
■.\x + y\ < p] and valued in W^, d ^ 1. If four vertices (x', y'), (x", y'), 
(x', y") and (x", y") of a rectangle belong to the strip, then: 

|/(x",y") - /(x',y") - /(x",y') + /(x',y')| ^ WfW,^^ |x" - x'| \y" - yf . 

A similar inequality holds by reversing the roles of the variables x and y. 

Proof. We apply twice the Taylor integral formula (1.2) with respect to the vari- 
able X and we maj orate: 

I (/(x", y") - /(x', y")) - (/(x", y') - /(x, y')) N 



E 



•5/ / / , (II i\ ii\ ^/ 11, I II i\ i\ 
— (x+s(x -x),y )- — (x +s(x -x),y) 



lrJy"-yrK-x1- ° 



I // / I r 
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Lemma 4.5. Let n ^ 1, let x e M", let p > and let H = H{t) be a C^'" map, 
with < a ^ 1, defined in the open cube = {|t| < p} and valued in W^. Let 
X, y, z with |x| , |y| , |z| ^ p/2>, so that the four points x, y, z and x + y — z constitute 
the vertices of a parallelogram which is contained in Dp. Then: 

\H{x + y - z) - H{x) - H{y) + H{z)\ ^ 4 \\H\\q^ |y - z| |x - zj" • 

A similar inequality holds after exchanging x and y. 

Proof. To estimate the second difference of H, we introduce a new map 

/(x,y) :=H{x + y), 

of (x, y) G M" X M", whose domain is the strip {|x + y| < p}. Let x, y, z with 
|x|,|y|,|z| ^ p/3. Fixing x' G R" aitttrary, there exist unique y', x" and y" 
solving the linear system: 

{1,1 II , II , 

x+y=z, X +y =x + y-z, 
I , II II , I 

x+y=x, x+y=y. 

In fact, y' = z — x', x" = y — z + x' and y" = x — x". Taking the norms | • | of the 
four equations above, we see that the rectangle (x',y'), (x",y'), (x',y"), (x",y") 
is contained in the strip {|x + y| < p}. Applying then Lemma 4.4 (with m = n), 
we get: 

\H{x + y - z) - H{x) - H{y) + H{z)\ = 

= |/(x",y")-/(x',y")-/(x",y') + /(x',y')| 

^ii/iicaK'-x'l|y"-yT 

= ||/||f;^Jy-z||x-zr. 

We claim that ||/||f^ ^ 4 which will conclude. Carefulness and rigor ai^e 

required. In fact, to estimate: 

II ,11 _ l/x.(x^yO - /x.(x^yO| + |/y.(x^yO - fy^{x',y')\ 

~l (x",Y")T^(x'y) Kx ,y j - (,x ,y j| 

we shall first transform the denominator. By definition: 

1/ // //\ / / i\\ n II i\ I // /|\ 

|(x ,y ) - (x ,y )| = max (|x - x | , |y - y |j . 

If we set a := \x" — x'\ and b := |y" — y'| and if we invert the inequality (a + 
6)° ^ 2 max (a", 6°), noticing 2" ^ 2, we obtain: 

1 12 2 



|(x",y") - (x',y')r max(a<^,6°) ^ + (|x" - x'| + |y" - y'|)° 

2 

^ |x" + y" -x' 
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Replacing the denominator above, we then transform and majorate the numerator: 

, f \Hu{>^" + y") - Hujy^' + yQI + \Hu{y^" + y") - ^t,(x- + /) 

^ ^ , ,. . I |x" + y" - x' - y'l" 



i=l (x",y")7^(x',y') 



4 E ™p ( '"■''?-.?:■"'" ) 



7i t'Yt 

II 111, a 

This completes the proof of Lemma 4.5. □ 

We can now state a slightly simplified version of Lemma 3.13. 

Lemma 4.6. ( IITul990L [*]) Let u€W^, d^l, let pi > and let ^' = ^'(u) be 
a C^''^ map, with < a ^ 1, ti S W^, defined in the cube {\u\ < pi} and valued 
inR'^. LetU^.U"^ G Ci'°(aA,M^) with |C/^(e*^)| < pi/2, on dA,forj = 1,2. 
For every (5 with < /3 ^ a the following inequality holds: 

||*(C/2(.))-^(f/H-))|lco,.(aA)<D||C/2-C/i||„_^, 

with 

^ = m,,, [l + 2(||f/Nlco)' + 2(||f/^||co)'' 
Proof. Firstly and obviously: 

||*(f/^)-^(f/^)|lo,o^ll^lli7oll^'-^'llo,o' 



Secondly, we have ||M/(C/2) _ = supo<|,._e'|^. (Q/ 1^" - )> 

where: 

Q:= \^{U\^'")) -^{U\e''")) -^{U\e''')) +^{U\e'''))\. 

To majorate Q, we start by inserting the term ^' [[/^ (e* ^" ) + 1/^ (e* ^' ) - C/^ (e* ^' )] , 
well-defined, thanks to the assumption ||[/-' ||p ^ < pi/3: 

Q ^|v&([/2(e^^")) - M/[[/i(e*^") + U\e''') - U\e''')\ | + 
+ \^[U\e''") + [/2(e'^') - C/i(e^^')] - ^{U\e''"))- 

-^{U^{e'''))+^{U\e'''))\. 

To estimate the second absolute value, we apply Lemma 4.5 with x = ?7^(e*^"), 
withy = C/2(e^^') and with z = [/^(e*^'): 

Q ^ 1^1 Co - U\e''") - [U^ - U\e''')\ + 

+ 4 \U\e''') - U\e''')\\U\e''") - U\e''')\''. 
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We then achieve the remaining maj orations: 



^<Mr:o\\u'-u\-p\e"-e'f + 



+ ^mQ\\u'-u\J\\u% 



nil Ql 1 13 



Reminding that ||C/2 - t/^I^Q + ||C/^ - U^l^p = {V^ - U^\q ^ and summing, 
we obtain: 



0,/3 ■ 



A similar inequality holds with ( ||t^^||fo )^ instead of ( ||J7^||£-^ )^ . Taking the 
arithmetic mean, we find the symmetric quantity D of the lemma. The proof is 
complete. □ 

Proof of Lemma 3.13. By definition: 

R:=||cD(C/2(.),-,s)-c^(?7i(-),-,5)||co,/3(a^) 

= sup $(C/2(e^^),e^^s) - $(C/^(e^^),e^^s) + 
T2/je"\ je" \ rr./TTifJ""- 



+ sup 



-^{U\e'''),e''',s)+^{uHe'''),e''',s] 



In the numerator, we insert (C/^ (e* ^" ) , e* ^' , s) + <I> [U^ (e* ^" ) , e* ^' , s) plus its 
opposite: 

R^ll^lli7oll^'-^'llo,o + 

io". 



+ sup 



+ sup 



-^{U\e''"),e''',s)+^{UHe''"), e' , s) 



+ 



To majorate the first supgn^g/, we apply Lemma 4.4 with x' = [7^(e*^"), y' = 
e*^', x" = C7^(e*^") and y" = e*^', where s is considered as a dumb parameter. 
To majorate the second supg„^g,, we apply Lemma 4.6 to ^'(u) := ^[u, e*^, s). 
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where (e*^, s) are considered as dumb parameters. We get: 

+ ||$|L--,sup U\e'')-U\e'') 

,/3 



+ ll^lli. 



,13 



1 + 2 \\U^ 



11,0 



+ 

+ 2 ( \\U^\ 



1,0 



l0,/3 • 



To conclude, we use i^J^ij-Q + ||^*||£~j ^ 11*^ II 1/3 ^^'^ E.^^ "^^e term C of 



Lemma 3.13. 



□ 



With these techniques, the proofs of Lemmas 3.17, 3.19, 3.30, 3.31 and 3.32 
are easily guessed and even simpler. 
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V: Holomorphic extension of CR functions 



Table of contents 

1. Hartogs theorem, jump formula and domains having the holomorphic extension 
property 153. 

2. Trepreau's theorem, deformations of Bishop discs and propagation on hyper- 
surfaces 166. 

3. Tumanov's theorem, deformations of Bishop discs and propagation on generic 
submanifolds 178. 

4. Holomorphic extension on globally minimal generic submanifolds 192. 

[19 diagrams] 



The method of analytic discs is rooted in the very birth of the theory of func- 
tions of several complex variables. The discovery by Hurwitz and Hartogs of 
the compulsory extension of holomorphic functions relied upon an application of 
Cauchy's integral formula along a family of analytic discs surrounding an illusory 
singularity. Since H. Cartan, ThuUen, Behnke and Sommer, various versions of 
this argument were coined "Kontinuitattsatz" or "Continuity principle". 

The removal of compact singularities culminated in the so-called Hartogs- 
Bocimer ttieorem, usually proved by means of integral formulas or thanks to the 
resolution of a 9 problem with compact support. Contradicting all expectations, 
a subtle example due to Fornaess (1998), shows that on a non-pseudoconvex do- 
main, the disc method may fail to fill in the domain, if the discs are required to 
stay inside the domain. 

Nevertheless, it is of the highest prize to build constructive methods in order 
to describe significant parts of the envelope of holomorphy of a domain, of a 
CR manifold, as well as the polynomial hull of certain compact sets. In such 
problems, analytic discs with boundary in the domain, the CR manifold or the 
compact set remain the most adequate tools. 

The precise existence Theorem 3.7(IV) for the solutions of Bishop's equation 
that was established in the previous Part IV may now be applied systematically to a 
variety of geometric situations. In this respect, we just followed Bishop's genuine 
philosophy that required to ensure an explicit control of the size of solutions in 
terms of the size of data, instead of appealing to some general, imprecise version 
of the implicit function theorem. 

Thanks to the jump theorem, holomorphic extension of CR functions defined 
on a hypersurface M is equivalent to the extension of the functions that are holo- 
morphic in one of the two sides to the other side. Trepreau's original theorem 
(1986) states that such an extension holds at a point p if and only if there does 
not exist a local complex hypersurface S of C" with p G S C M. A deeper 
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phenomenon of propagation (Trepreau, 1990) holds: if CR functions extend holo- 
morphically to one side at a point p, a similar extension holds at every point of 
the CR orbit of p in M. By means of deformations of attached Bishop discs, there 
is an elementary (and folklore) proof that contains both the local and the global 
extension theorems on hypersurfaces, yielding a satisfactory understanding of the 
phenomenon. 

On a generic submanifold M of C" of higher codimension, the celebrated Tu- 
manov extension theorem (1988) states that CR functions defined on M extend 
holomorphically to a local wedge of edge M at a point p if the local CR orbit of p 
contains a neighborhood of p in M. A globalization of this statement, obtained in- 
dependently by Joricke and the first author in 1994, states that the same extension 
phenomenon holds if M consists of a single CR orbit, i.e. is globally minimal. 
Both proofs heavily reUed on the local Tumanov theorem and on a precise control 
of the propagation of directions of extension. 

A clever proof that treats both locally minimal and globally minimal generic 
submanifolds on the same footing constitutes the main Theorem 4.12 of the 
present Part V: ifM is a globally minimal C^'" (0 < a < 1) generic submanifold 
of of codimension ^ 1 and of CR dimension ^ 1, there exists a wedgelike 
domain W attached to M such that every continuous CR function f G C^^(M) 
possesses a holomorphic extension F G 0{yV)r\C^{AdWW) with F\m = f ■ This 
basic statement as well as the techniques underlying its proof will be the very start- 
ing point of the study of removable singularities in Parts VI and in IIMP2006all . 

§1. HARTOGS theorem, jump FORMULA 
AND DOMAINS HAVING THE EXTENSION PROPERTY 

1.1. Hartogs extension theorem: brief history. In 1897, Hurwitz showed that 
a function holomorphic in C^\{0} extends holomorphically through the origin. 
In his thesis (1906), Hartogs generalized this discovery, emphasizing the com- 
pulsory holomorphic extendability of functions that are defined on the nowadays 
celebrated Hartogs skeleton (diagram below). The main argument is to apply 
Cauchy's integral formula along families of analytic discs having their boundary 
inside the domain and whose interior goes outside the domain. In fact, the thin- 
ness of an embedded circle in C" (n ^ 2) offers much freedom to include illusory 
singularities inside a disc. 

In 1924, Osgood stated the ultimate generalization of the discovery of Hurwitz 
and Hartogs: ifQc (n ^ 2) is a domain and if K d VI is any compact such 
that Q\K connected, then 0{Q\K) = 0{fl)\Q\x. This statement is nowadays 
called the Hartogs-Bochner theorem. Although the proof of Osgood was coiTcct 
for geometrically simple complements Q\K, as for instance spherical shells, it 
was incomplete for general ^\K. In fact, unpleasant topological and monodromy 



further historical information may be found in ||Ral9861 |Strl988l |Fil9911 IRa2002l 
IHM2002I . 
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obstructions occur for general Q,\K when pushing analytic discs. In 1998, For- 
naess exhibited certain domains in which discs are forced to first leave some in- 
termediate domain 0,\Ki, Ki C K, before Q, may be filled in. 

In the late 1930's, a rigorous proof of Osgood's general statement was obtained 
by Fueter, by means of a generalization of the classical Cauchy-Green-Pompeiu 
integral formula to several variables, in the context of complex and quaternionic 
functions (Moisil 1931, Fueter 1935). In 1943, Martinelli simplified the formal 
treatment of Fueter. Then Bochner observed that the same result holds more gen- 
erally if one assumes given on dQ just a CR function. 




Filling in the Hartogs skeleton by means of analytic discs 



1.2. Hartogs domain. Consider the e-Hartogs skeleton (pot-looking) domain: 

He := {{zi,Z2) £ : l^i] < 1, \z2\ < e} |J {1 - e < \zi\ < 1, \z2\ < 1}. 
We draw two diagrams: in (|2:i|, |2:2|) and in (xi, yi, \ z2\) coordinates. 

Lemma 1.3. Every holomorphic function f £ 0{7ie) extends holomorphically 
to the bidisc A x A, the convex hull of Tie- 
Proof. Letting 5 with < 5 < e, for every Z2 £ C with \ z2\ < 1, the analytic disc 

A9C^^..(C) :=([1-5]C,^2)gC2 

has its boundary Az2{dA) contained in He, the domain where the function / is 
defined. Thus, we may compute the Cauchy integral 



F{zuZ2):=:^ [ 



Differentiating under the sum, this extension F is seen to be holomorphic. In 
addition, for \z2\ < e, it coincides with /. Obviously, the discs Az2{A) fill in the 
hole of the domain T^p. □ 
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1.4. Bounded domains in C" and Hartogs-Bochner extension phenomenon. 

Let be a connected open subset of C", a domain. We assume it to be bounded, 
i.e. Q is compact and that its boundary dil := is a hypersurface of of 
class at least C^. By means of a partition of unity, one can construct a real-valued 
function r defined on C" such that Q = {z : r{z) < 0} and = {z : r{z) = 0}, 
with dr{z) ^ for every z G dVl. Then dO. is orientable. 

Extensions of the above disc argument led to the most genera form of the 
Haitogs theorem: if is a bounded domain in C" (n ^ 2) having connected 
boundary d^l, then every function holomorphic in a neighborhood ofdVl uniquely 
extends as a function holomorphic in Vl. There are three classical methods of 
proof: 

• using the Bochner-Martinelli kernel; 

• using solutions oi du = v having compact support; 

• pushing analytic discs, in successive Hartogs skeletons. 

The first two are rigorously established and we shall review the first in a while. 
For almost one hundred years, it has been a folklore belief that the third method 
could be accomplished somehow. Let us be precise. 

1.5. Fornaess' counterexample and a disc theorem. Thus, let $7 be a bounded 
domain of having connected boundary For 5 > small, consider the 
one-sided neighborhood of dO, defined by: 

^5 := {z E : dist {z, 89) < 6}. 

The complement Q\Qs is a compact hole. Remind that the bidisc is the convex 
hull of the Hartogs skeleton He. Following IIF1998II . we say that O can be filled 
in by analytic discs if for every 5 > 0, there exist a finite sequence of subdomains 
of 9 having boundary, Qs = 9.i C 0,2 C ■ ■ ■ C 0,k = 9 and for each 
j = 1, . . . , k — 1, an Ej > and a univalent holomorphic map $j defined in a 

2 

neighborhood of A such that: 

(1) fij+i c % u^>j(a2) c n-, 

(2) <^j{ne) C %; 

(3) Qj n <l>j (A^) is connected; 

(4) Jlj+i n <I>j (A^) is connected. 

For such domains, by pushing analytic discs in the embedded Hartogs figure, 
taking account of connectedness, we have ©(Oj+i)]^ = 0{Qj). Then by induc- 
tion, uniquely determined holomorphic extension holds from f^i up to 17. Impor- 
tantly, the intermediate domains are required to be all contained in Q. 

Often, some authors consider instead a compact K C with fi\K connected and 
state that 0{n\K) = 0(f2)|^^^^; a technical check shows that the two statements are 

equivalent. 
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In 1998, Fornaess IIF1998II constructed a topologically strange domain C 
that cannot be filled in this way. This example shows that the requirement that 
Qj C C O is too stringent. 

Nevertheless, taking care of monodromy and working in the envelope of holo- 
morphy of (7, one may push analytic discs by allowing them to wander in the 
outside, in order to get the general Hartogs theorem stated above. As a pre- 
liminary, one perturbs and smoothes out the boundary. Denote by ||2|| := 

1 /2 

+ • • • + l-ZnP) the Euclidean norm of z = {zi, . . . , Zn) G C" and by 
]B"(p, 5) := {\\z — p\\ < 5} the open ball of radius 6 > centered at a point p. 

Theorem 1.6. ( IIMP2006cll ') Let M ^ (n ^ 2) be a connected C°° hypersur- 
face bounding a domain Q.m <e C". Suppose to fix ideas that 2 ^ dist (O, ^ 
5 and assume that the restriction vm ■= r\M of the distance function r{z) = \\z\\ 
to M is a Morse function having only a finite number k of critical points p\ £ M, 
1 ^ A ^ K, located on different sphere levels: 

2 <^?i := r{pi) < • • • < := r{pf,) ^ 5 + diam(r2A/)- 

Then there exists 6i > such that for every 5 with < 6 < 6i, the (tubular) 
neighborhood 

VsiM) := VJp^mW\p,5) 
enjoys the global Hartogs extension property into VIm '■ 

by "pushing" analytic discs inside a finite number of Hartogs figures, without 
using neither the Bochner-Martinelli kernel, nor solutions of some auxiliary d 
problem. 

1.7. Hartogs-Bochner theorem via the Bochner-Martinelli kernel. By 0{C), 
where C C C" is closed, we mean C'(V(C)) for some open neighborhood V(C) 
of C. Here is the general statement. 

Theorem 1.8. ( IIHeLel984[|Hel985[lRaT986l ') Let Vibe a bounded domain in C" 
having connected boundary. Then for every neighborhood U of dil in and 
every holomorphic function f G 0{U), there exists a function F G 0{Vt) with 
F\dn = flan- 

In the thin neighborhood U of the not necessarily smooth boundary dQ, by 
means of a partion of unity, one may construct a connected boundary dQi C 
U close to dQ which is C^, or C°°, or even C", using Whitney approximation 
( BHi 197611 : in addition, one may assure that f{z)\Q^^ is as in Theorem 1.6, whence 
both statements are equivalent). Then the restriction F\gQ-^ is CR on dQi and the 
previous theorem is a consequence of the next. 
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Theorem 1.9. niRal986l IHel985D Let Q be a bounded domain in C" (n ^ 2) 
having connected C'" boundary, with I^k^cxd, O^a^l. Tlien for every 
CR function f : C of class C^'", there exists a function F £ 0{^}) H 

C-'"(n) with Flan = f. 

Some words about the proof. With (,z G C", consider the Bochner-Martinelli 
kernel: 

■= 7^ " "'"'"^ ^ " '^^^ k% 

This is a (n, n — l)-form which is off the diagonal {C, = z}. For 7i = 2, 
it coincides with the Cauchy kernel ^ If / and are C^, the integral 
formula: 

F{z) := / fiC)BM{C,z) 
Jan 

provides the holomorphic extension F. 

1.10. Hypersurfaces of C" and jump theorem for CR functions. Let M be a 

real hypersurface of C" without boundary. In the sequel, we shall mainly deal 
with three geometric situations. 

• Local: M is defined in a small open polydisc centered at one point p G 

M. 

• Global: M is a connected orientable embedded submanifold of C". 

• Boundary: C"\M consists of two open sets bounded and Q,^, un- 
bounded. 

Then there exists some appropriate neighborhood of M in C" in which M 
is relatively closed, in the sense that M n Ai = M. 

More generally, let M be an arbitrary complex manifold of dimension n ^ 1 
and let M C be a hypersurface of class at least which is relatively closed 
in M and oriented. The complement M\M then consists of two connected com- 
ponents 17+ and Q^, where 17+ is located on the positive side to M. Also, let 
f : M ^ C be a CR function of class at least C^. By definition, / is CR if the 
current of integration on M of bidegree (0, 1) defined b)0: 

/mM:= / fio, L0£V^'^-\ 
Jm 

satisfies j^^ / dzu = for every w G pn,n-2 Equivalently, dfM = in the 
sense of cun^ents, where /m is interpreted as a (0, l)-form having measure coef- 
ficients. 



Here, P^'"'? is the space of C°° forms of bidegree {p,q) having compact support; 
fundamental notions about currents may be found in llCh 19891 . 
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To formulate the jump theorem in arbitrary complex manifolds, we shall mainly 
assume that the Dolbeault 9-complex on Ai is exact in bidegree (0, 1), namely 
H^'^ {M) =0. This assumption holds for instance when M = A'\ C" or P„(C). 

It means that the equation du = v, where is a c?-closed (0, l)-form on M having 
C°° , or distributional coefficients has a C°° , or distributional solution u on 
M. 

Consequently, there exists a distribution F on Ai with dF = Jm- As 
supp/m C M, such a function F is holomorphic in J\A\M. The difference 
F2 — Fi of two solutions to dF = f'M is holomorphic in . In the case where 
M = C", a solution to dF = /m may be represented ( IIChl975[ IRal986ll ) by 
means of the Bochner-Martinelli kernel as F{z) := f{C) BM((^, z). In com- 
plex dimension n = I, such a solution coincides with the classical Cauchy trans- 
form. 

In 1975, after previous work of Andreotti-Hill ( ||AH1972bD . Chirka obtained a 
several complex variables version of the Sokhotskii-Plemelj Theorem 2.7(IV). 

Theorem 1.11. ( IIChl975ll ) Assume that H^^{M.) = and that the hypersurface 

M C M is orientable and relatively closed, i.e. M^\^A = M. Assume dim. ^A = 
n ^ 1 and let (k, a) with < k < 00, < a < 1. If M is C^^'" and 
if the current Jm associated to a C^'" function f : M ^ C is CR, then every 
distributional solution F G 0{Ai\M) to dF = Jm extends to be C'" in the two 
closures = U M, yielding two functions F^ E 0{n^) H C^'"(0=t U M) 
whose jump across M equals /: 

F+{z) - F-{z) = f{z), "izeM. 

A similar jump formula holds for f G L|'^^^^(M), with M at least (or a 
Lipschitz graph) and for f £ 'D'^j^{M), with M £ C°°. 

When M = C, the conditions that / is CR and that H^'^{M) = are automat- 
ically satisfied and we recover the Sokhotskii-Plemelj jump formula. However, 
we mention that in several complex variables (n ^ 2), there is no analog of the 
second formula ^ [F"''((^o) + -^~(Co)] = P-v. /p dC,. The reason is the 
inexistence of a universal integral formula solving dF = /m- Nevertheless, there 
should exist generalized principal value integrals which depend on the kernel. 

If M is only and / is only C^, it is in general untrue that F~ and F"*" 
extend continuously to M. Fortunately, there is a useful substitute result, analog 
to Theorem 2.9(IV). Consider a open subset M' C M having compact closure 
M' not meeting dM = M\M. We may embedd M' in a one-parameter family 
(M^)|g|^gy, eq > 0, of hypersurfaces that foliates a strip thickening of M'. 

Theorem 1.12. niChl975ll ) /// is CR and on a 0"+^ hypersurface M, then 
hm\\F\M^-F\M'_^-fl = 0. 
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1.13. CR extension in the projective space. Unlike in C", there is no privileged 
"interior" side of an orientable connected hypersurface in the projective space 
Pn{C), n ^ 2. Nevertheless, a version of the Hartogs-Bochner theorem holds. 
The proof is an illustration of the use of the jump theorem. 

Theorem 1.14. (n ^ 3: IIHL1975II : re = 2: IISal999[ lDM2002ll ') Let M be a 

compact orientable connected real hypersurface of Pn{C) that divides the pro- 
jective space into two domains 0,~ and r^"*". Then: 

(i) there exists a side, 0^ or 0^, to which every function holomorphic in 
some neighborhood ofM extends holomorphicall^^. 

(ii) every function that is holomorphic in the union of the other side of M 
together with a neighborhood of M must be constant. 



Let us summarize the proof. Let / be holomorphic in some neighborhood 
V{M) of M in Pn{C). As the Dolbeault cohomology group if°'i(P„(C)) van- 
ishes for n ^ 2 ( IIHeLel984[|Hel985ll '). thanks to Theorem 1.11 above, the CR 
function f\M on M can be decomposed as the jump / = F"^ — F~ between 
two functions holomorphic in fi^ which are (at least) continuous up to M. It 
suffices then to show that either or is constant, since clearly, if F"*" (resp. 
F~) is constant equal to c"*" (resp. c~), then / extends holomoiphically to Q,~ 
(resp. to 0+) as c+ — F~ (resp. as F+ — c^). 

By contradiction, assume that both F^ and F~ ai^e nonconstant. We choose 
two domains C/+ and with V(M) U 0=^ D [7=^ D M U 0=^. By a preliminary 
(technical) deformation argument, we may assume that F^ is holomorphic in 
U^. According to a theorem due to Takeuchi MTa 196411 , holomorphic functions 
in an arbitrary domain of Pn{C) (re ^ 2), either are constant or separate points. 
Since F^ is nonconstant, 0{U~) separates points. Conjugating with elements 
of the group PGL(re, C) of projective automorphisms of P„(C), shrinking V(M) 
and U~ slightly if necessary, we may verify ( IIDM2002II ) that 0{U~) separates 
points and provides local system of holomorphic coordinates at every point. By 
standard techniques of Stein theory ( ||Hol973l ), it follows that is embeddable 
in some C^, with N lai^ge. The image of M under such an embedding $ is a 
compact CR submanifold of that is filled by the relatively compact complex 
manifold = <!>([/") with boundary <I>(M). Two applications of the maximum 
principle to the nonconstant holomorphic function F"*" o say that it must 
decrease inside S~, since S~ is interior to ^{M) in C^, and that it must increase, 
since the one-sided neighborhood J7~nV(M)is exterior to U^. This is the desired 
contradiction. 



Using propagation techniques of Section 3, the theorem holds assuming that AI is 
globally minimal and considering continuous CR functions on M. 
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1.15. Levi extension theorem. A hypersurface M C C" may always be rep- 
resented as M = {z G ?7 : r{z) = 0}, where U is some open neighborhood of 
M in C", and where r : ^ M is a imphcit defining function that satisfies 
dr{q) / at every point q of M. Two defining functions r^, are nonzero mul- 
tiple of each other in some neighborhood V <Z U oi M: there exists A : y — > M 
nowhere vanishing with r2 = Ari. 
At a point p e M, the Levi fonn of r: 

is a Hermitian form that may be diagonalized. Its signature at p: 

{ap,bp) := (# positive eigenvalues, # negative eigenvalues) 

is the same for ri and r2 if they are positive multiples of each other. It is also 
invariant through local biholomorphic changes of coordinates z i— > that do 
not reverse the orientation of M. Reversing the orientation or taking a negative 
factor A corresponds to the transposition {ap, bp) i— > {bp, ap). 

The Levi form may be read off a graphed equation v = (/^(x, y, u) for M. 

Lemma 1.16. There exist local holomorphic coordinates (z, u + iv) G C"~^ x C 
centered at p in which M is represented as a graph of the form: 

v = Lp{z,u)= ^ fSfc ZfcZfc + o(|zp) + 0(|z| liil) + Odiip), 

where Ek = +lforl ^ k ^ Up, Ek = —lforap + 1 ^ ap + bp. If ap = n—1, 
the open set {v > is strongly convex (in the real sense) in a neighborhood of 
p. 

Assuming that M is orientable, it is surrounded by two open sides. By an open 
side of M, we mean a connected component of V\A/ for a (thin) neighborhood 
V of M which is divided by M in two components. As germs of open sets along 
M, there exist two open sides (if M were not orientable, there would exist only 
one). 

Assuming that M is represented either by an implicit equation r = or as a 
graph —V + (p{x, y, u) = 0, we adopt the convention of denoting: 

Q+ ._ 1^ ^ Q| ^+ ._ 1^ y ip{x,y,u)}, 

:= {r > 0} or $7" := {v < ip{x,y,u)}. 

Once a local side of M has been fixed, M is oriented and the indetermination 
r ^ —r disappeai^s. By convention, we will always represent = {r < 0}. 
Then the number of positive and of negative eigenvalues of the Levi-form of r at 
a point p G d^} is an invariant. By common abuse of language, we speak of the 
Levi form of dQ. 
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At one of its points p, a boundaiy dfl is called strongly pseudoconvex (resp. 
strongly pseudoconcave) if its Levi form has all its eigenvalues > (resp. < 0) 
at p. It is called weakly pseudoconvex (resp. weakly pseudoconcave) at p if all 
eigenvalues ai^e ^ (resp. ^ 0). Often, the term "weakly" is dropped in common 
use. 

Definition 1.17. If is an open side of AI, we say that 17 is holomorphically 
extendable at p if for every oper0 polydisc Up centered at p, there exists an open 
polydisc Vp centered at p such that for every / G 0{Q n Up), there exists F G 



0{Vp) with F\ 



nnVr, 



f\ 



In 1910, Levi localized the Hartogs extension phenomenon. 



Theorem 1.18. ( IIBol9911|Trpl996|lTuT998[IBER1999ll ') If the Levi form ofM C 
(90 has one negative eigenvalue at a point p, then Vt is holomorphically extendable 
at p. 

Proof. As Q. is given by {v > —zizi + •••}, for e > small, the disc A^{C,) := 
(e C, 0, . . . , 0) has its boundary ^^(SA) contained in Q. near p. 

Lemma 1.19. Assume M is C^, let p ^ M and O be an open side of M at p. 
Suppose that for every open polydisc Up centered at p, there exists an analytic 
disc A : Is. ^ Up continuous in A with A{Q) = p and A{d/\) C Vt. Then Q. is 
holomorphically extendable at p. 

To draw A(A), decreasing by 1 its dimension, we represent it as a curve. The 
cusp illustrates the fact that ^(A) is not assumed to be embedded. 




To prove the lemma, we may assume that p = 0. Since A{dlS.) is contained 
in 0, for z G C" very small, say \z\ < 6, the translates z + A{dA) of the disc 
boundary are also contained in 0. 



Although the shape of polydiscs is not invariant by local biholomorphisms, their 
topology is. To avoid dealing implicitly with possibly wild open sets, we prefer to speak 
of neighborhoods Up, Vp, Wp of p that are polydiscs. 
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Consequently, the Cauchy integral: 

m--=^. I f(z + A{C))f 

is meaningful and it defines a holomorphic function of z in the poly disc Vp := 

{\z\<S}. 

Does it coincide with f mVpCi^l The assumption that M is yields a local 
real segment £p transversal to M at p. If Up is sufficiently small and if z ^ ipPiQ 
goes sufficiently deep in $7, the disc z+A{A) is contained in fi, so that the Cauchy 
integral F{z) coincides with f{z) for those z. □ 

1.20. Contact of weakly pseudoconvex domains with complex hypersurfaces. 

The domain Q is said to admit a support complex hypersurface atp £ dO, if there 
exists a local (possibly singular) complex hypersurface S passing through p that 
does not intersect Q. In this situation, if S = {h{z) = 0} with h holomoiphic, 
the function 1/h does not extend holomorphically at p, being unbounded. With 
a > not integer, one may define branches /i" which are uniform in and 
continuous up to dQ, but whose extension through p would be ramified around S. 
Consequently, the existence of a support complex hypersurface prevents 0{Q) to 
be holomorphically extendable at p. Is it the right obstruction ? For instance, at a 
strongly pseudoconvex boundary point, the complex tangent plane is support. 

Nevertheless, in 1973, Kohn-Nirenberg constructed a special pseudoconvex do- 
main 0(^1^ in showing that: 

• not every weakly pseudoconvex smoothly bounded domain is locally bi- 
holomorphically equivalent to a domain which is weakly convex in the 
real sense; 

• the holomoiphic non-extendability of at p is totally independent 
from the existence of a local supporting complex hypersurface at p. 

The boundary of this domain 

Mkn := {iz,w) G : Imt/; = \zw\'^ + z'^z^ + 15 {z'^ z + f z)/U} 

may be checked to be strongly pseudoconvex at every point except the origin, 
where it is weakly pseudoconvex. Hence 0{Q,^^) is not holomorphically ex- 
tendable at the origin. However, A/kn has the striking property that every lo- 
cal (possibly singular) complex hypersurface S passing through the origin meets 
both sides of Mkn in every neighborhood of the origin. By means of a Puiseux 
parametrization ( llJaPf 20001 ). such a complex curve S is always the image of a 
certain holomorphic disc A : A ^ with A(0) = 0. 

Theorem 1.21. ( IIKN1973II ) Whatever the holomorphic disc A, for every e > 0, 
there are C,~ and C,^ in A with \C,^\ < £ such that A(C^) S ^kn- 

Clearly, ^^^^ is not locally convexifiable at the origin (otherwise, the biholo- 
morphic image of the complex tangent line would be support). 
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Often for technical reasons, certain results in several complex variables require 
boundaries to be convex in the real sense. Although this condition is not biholo- 
morphically invariant, it is certainly meaningful to characterize the class of con- 
vexifiable domains, at least locally: does there exist an analytico-geometric crite- 
rion enabling to recognize local convexifiability by reading a defining equation ? 

1.22. Holomorphic extendability across finite type hypersurfaces. Let M be 

a hypersurface and let p G M. Then M is of type m at p, in the sense of 
Definition 4.22(111), if and only if there exists a local graphed equation centered 
at p of the form: 

V = ifU^, z) + 0(|zr+i) + 0{\z\ \u\) + 0(hp), 

where tpm £ C[z, z] is a nonzero homogeneous real- valued polynomial of degree 
m having no pluriharmonic term, namely = i/3m(0, z) = ipm{z, 0). The restric- 
tion (pmWC),W)) of to a complex line Cb £{() € C"-\ ^(0) = 0, is 
a polynomial in C[C, C]- For almost every choice of i, this polynomial is nonzero, 
homogeneous of the same degree m and contains no harmonic term. After a rota- 
tion, such a line is the complex zi-axis. Denoting z' = {z2, . . . , Zn-i), we obtain: 

(1.23) V = ^m{zi,zi) + 0(|zir+i) + 0{\z'\) + 0{\z\ \u\) + 0{\u\^). 

Theorem 1.24. ( IIBeFol978[ IR1983I IBT1984II ) // m is even, at least one side 
or il" is holomorphically extendable at p. If m is odd, both sides have this 
property. 

Proof. Let e > arbitrarily small, let a G C with \a\ < 1, let ^ be in the closed 
unit disc A, and introduce a C^-valued analytic disc: 

A,{0 := (e(a + C),0,...,0,e-W^(C)) 

having zero z'-component and zi -component being a disc of radius e centered at 
—a. We assume its itj-component W{() be defined by requiring that the C^-valued 
disc 

B,{C) ■.= {eia + C),e"'WiO) 

has its boundary Bi;{dA) attached to v = ipm{zi,zi). By homogeneity, drops 
and it is equivalent to require that Bi is attached to ?; = ipm{zi, zi). Equivalently, 
the imaginary part V{C) ofW = U + iV should satisfy: 

for all e*^ G OA. To obtain a harmonic extension to A of the function V thus 
defined on dA, no Bishop equation is needed. It suffices to take the harmonic 
prolongation by means of Poisson's formula, as in §2.20(IV): 
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Since ipm has no harmonic term, it may be factored as ipm = ziziij)i{zi,z\), 
with ■01 G C[zi, zi] homogeneous of degree (m — 2) and nonzero. In the integral 
above, we put rj := —a and we replace = ziziipi to get the value of V at —a: 



As a function of o G A, the last integral is identically zero if and only if the 
polynomial Tpi is zero. Thus, there exists a such that V{—a) / 0. (However, we 
have no information about the possible signs of V{—a) in terms of v?™-) Then 
we define U{C) to be the harmonic prolongation of — JV that vanishes at —a and 



The positivity (resp. negativity) of the sign of V{—a) means that B^{—a) = 
(0, a)) is in Q'^ (resp. Then after translating slightly B^, in the right 

direction along the u-axis. Lemma 1.19 applies to deduce that Q.'^ C (resp. 
Q-i C C^) is holomorphically extendable at the origin. Since iprn{—zi, —zi) = 
(—1)'" ^pjn{zi, zi), in the case where m is odd, the disc —B^ will also be attached 
to Ml and will provide extendability of the other side. 

Thanks to basic majorations of the "O" remainders in the equation (1.23) of 
M, if e > is sufficiently small, then Q~ C C" (resp. 0+ C C"^) has the same 
extendability property. □ 

If M is a real analytic hypersurface, it is easily seen, by inspecting the Taylor 
series of its graphing function, that M is not of finite type at a point p if and only 
if it may be represented hy v = u ip{z, u), with Lp G . Then the local complex 
hypersurface = u = 0} is contained in M. 

Corollary 1.25. ( IIBeFol9781 [R19831 IBTT9841 ) If M is and ifpGM, the 
following properties are equivalent: 

• M has finite type at p; 

• M does not contain any local complex analytic hypersurface passing 
through p; 

• or Q~ is holomorphically extendable at p. 

1.26. Which side is holomorphically extendable ? We claim that it suffices to 
study osculating domains in of the form: 

:= {—V + ipm{z, z) < 0}, z e C, w = u + iv e C, 

where 7^ is real, homogeneous of degree m ^ 2 and has no harmonic term. 
Indeed, extendability properties of such domains transfer to perturbations (1.23). 
Also, extendability properties of are just the same, via ipm —^m- For this 
reason, if m is odd, both r2+ and 0~ ai^e holomorphically extendable at p. 
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The local complex line {{z,0)} intersects the closure ili^^ in regions that are 
closed angular sectors (cones), due to homogeneity. We call these regions interior. 
The complement C^\Oj^ intersects {{z, 0)} in open, exterior sectors. 

Theorem 1.27. ( IIR19831 IBTT9841 IFR19831 ) If there exists an interior sector of 
angular width > then is holomorphically extendable at p. 

The proof consists in choosing an appropriate truncated angular sector as the 
z-component of a disc attached to 50+^ , instead of the round disc C, i— > e(a + C)- 

Example 1.28. Every homogeneous quartic v = 934(2;, z) in is biholomorphi- 
cally equivalent to a model 

= := —V + z^z^ + a zz{z'^ + z^), 

for some a G M. Such a hypersurface bounds two open sides ri+ = {r^ < 0} and 
n- = {ra > 0} which enjoy the following properties ( IIR1983[|BT1^84l ): 

• Q,~ is holomorphically extendable at p, for every a; 

• |a| < 2/3 if and only if Q'^ is everywhere strongly pseudoconvex; 

• |a| ^ 1/ \/2 if and only if 0+ is not holomorphically extendable at p; 

• |a| > 1/ \/2 if and only if i}'^ is holomorphically extendable at p; 

• the above extendability property holds true for any perturbation of dil by 
higher order terms. 

Finer results, strictly more general than the above theorem that apply to sixties, 
were obtained in IIFR1985I . If we remove all exterior sectors of angular width 
^ the rest of the complex line {(z,0)} is formed by disjoint closed sectors, 
which are called supersectors of order m of 0+^^ at p. A supersector is proper if 
it contains points of . 

Theorem 1.29. niFR1985D 

(i) If has a proper supersector of angular width > then is 
holomorphically extendable at p. 

(ii) If all supersectors of $7 have angular width < then there exists 
f G 0(17^^) n C^{Q^^ ) that does not extend holomorphically at p. 

Even in the case m = 6, some cases in this theorem are left open. Examples 
may be found in ||FR1985i 

Open problem 1.30. In the case where m is even, find a necessary and sufficient 
condition for ^Jj^ = {v > ^Pmiz, z)} to be holomorphically extendable at p, or 
show that the problem is undecidable. 

One could generalize this (already wide open) question to a not necessarily 
finite type boundary, C^, C°^, or even graph. 
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2. TREPREAU'S THEOREM, DEFORMATIONS OF BISHOP DISCS 
AND PROPAGATION ON HYPERSURFACES 



2.1. Holomorphic extension of CR functions via jump. Let M be a hypersur- 
face in C" of class at least C^'" with < a < 1 and let / be a continuous CR 
function on M. At each point p of M, we may restrict / to a small open ball (or 
polydisc) ilp centered at p. Applying the jump Theorem 1.11, we may represent 

f = F+ -F-, with e 0{n^)n C0(?7^). If n+ (resp. is holomorphi- 
cally extendable at p, then F~^ (resp. F^ ) extends to a neighborhood cjp of p in 
as G G 0{ujp) (resp. H G 0{u}p)). Then / extends holomorphically to the 
small one-sided neighborhood lo~ (resp. to ujp) as G — F~ (resp. as — H). 

Lemma 2.2. On hypersurfaces, at a given point, local holomorphic extendability 
of CR functions to one side is equivalent to holomorphic extendability to the same 
side of the holomorphic functions defined in the opposite side. 

Consequently, the theorems of §1.22 yield gratuitously extension results about 
CR functions. For instance: 

Corollary 2.3. ( l|BeFol9781 IR19831 IBT1984II ) On a real analytic hypersurface 
M, at a given point p, continuous CR functions extend holomorphically to one 
side if and only if M does not contain any local complex hypersurface passing 
through p. 

The assumption of real analyticity, or the assumption of finite typeness in case 
M is both consume much smoothness. The removal of these assumptions 
was accomplished by Trepreau in 1986. 

Theorem 2.4. (|Trpl986|) Let M be a C'^ hypersurface of C", n ^ 2 and let 



p G M. The following two conditions are equivalent: 

• M does not contain any local complex hypersurface passing through p. 

• for every open subset Up C M containing p, there exists a one-sided 



neighborhood uJp of M at p with ojp D M Up such that for every 
f G C^/j(f/p), there exists F G O{oo^) n C°(u;=^ U Up) with F\up = f. 

We have seen that characterizing the side of extension is an open question, even 
for rigid polynomial hypersurfaces v = (pm{z, z) and even for m = 6. Although 
the above theorem constitutes a neat answer for holomorphic extension to some 
imprecise side, it does not provide any control of the side of extension. 

Let M be a orientable connected hypersurface and let be an open side 
of M. One could hope to characterize holomorphic extension to the other side 
at every point of M, since weak pseudoconvexity characterizes holomorphic non- 
extendability at every point of M, by Oka's theorem. 
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Example 2.5. ( |Trpl992| ) In let be {v > ^.m{zi,zi) - |z2p \zi\^^} 



where ipm ^ 0, of degree m with 3 ^ m < is as in Open problem 1.30. One 
verifies that holomorphic extension at every point of M entails a characterization 
of holomorphic extension at the origin for the domain > ipr, 



(z, z] — e \z 



27V I 



In the sequel, we shall abandon definitely the difficult, still open question of 
how to control sides of holomorphic extension. 

Although Theorem 2.4 is well known in Several Complex Variables, there is a 
more general formulation with a simpler proof than the original one. The remain- 
der of this section will expose such a proof. 

By a global one-sided neighborhood of a connected (not necessarily orientable) 
hypersurface M C C", we mean a domain Qm with D M such that for every 
point q G M, at least one open side o;^ of M at g is contained in 17 In fact, to 
insure connectedness, is the interior of the closure of the union Ugg m of 
all (possibly shrunk) one-sided neighborhoods. 



Then Qm contains a neighborhood in C" of every point r G M which belongs 
to at least two one-sided neighborhoods that are opposite. The classical Morera 
theorem insures holomorphicity in a neighborhood of such points r. 

Remind that M is called globally minimal if it consists of a single CR orbit. 
The assumption that M does not contain any complex hypersurface at any point 
means that for every p G M, every open Up 3 p, the CR orbit OcR{Up,p) 
contains a neighborhood of p in M. This implies that M is globally minimal and 
hence. Theorem 2.4 is less general than the following. 



Theorem 2.6. ( gTrpl990|lTul994all ) Let M bJBa connected C^'" (0 < a < 1) 



hypersurface ofC^ (n ^ 2). If M is globally minimal, then there exists a global 
one-sided neighborhood 17 jv/ of M such that for every continuous CR function 
f £ C^jiiM), there exists F £0{VIm)^ C^i^M U M) with F\m = f. 



^'^ This theorem also holds true with M e and even with M € C^ " (0 < a < 1), 
provided one redefines the notion of CR orbit in terms of boundaries of small attached 
analytic discs. 



168 



JOEL MERKER AND EGMONT PORTEN 



It will appear that is contructed by gluing discs to M and to subsequent 
open sets il' C Um which are all contained in the polynomial hull of M: 

M := |z G C" : \P{z)\ ^ sup \P{w)\, V P G C[z]}. 

Let us summarize the proof. Although the assumption of global minimality is 
so weak that M may incorporate large open Levi-flat regions, there exists at least 
one point p G M in a neighborhood of which 

TgM = T^M + [T^M, T^M] , q £ Up. 

Otherwise, the distribution p TpM would be Frobenius-integrable and all CR 
orbits would be complex hypersurfaces ! At such a point p, the classical Lewy 
extension theorem (§2.10 below) insures that C^^(M) extends holomorphically 
to (at least) one side at p. 



Theorem 2.7. ( ]Trpl990[ |Tul994all ) Let M be a connected C^'" hypersurface. 



not necessarily globally minimal. If C^^{M) extends holomorphically to a one- 
sided neighborhood at some point p G M, then holomorphic extension to one side 
LO^ holds at every point q G Ocr{M,p). 

When Ocr{M, p) = M as in Theorem 2.6, the global one-sided neighborhood 
Qm will be the interior of the closure of the union Uq^m of all (possibly 
shrunk) one-sided neighborhoods. 

The next paragraphs are devoted to expose a detailed proof of both the Lewy 
theorem and of the above propagation theorem. 

2.8. Approximation theorem and maximum principle. According to the ap- 
proximation Theorem 5.2(111), for every p G M, there exist a neighborhood 
Up of p in M and a sequence {P,y{z))u&N of holomoiphic polynomials with 

lim^^oo \\Pu - /llco(c/p) = 0- 

Lemma 2.9. For every analytic disc A G 0{A) n C°(A) with A{dA) C Up, 
the sequence P^, also converges uniformly on the closed disc ^(A), even if A{/S) 
goes outside Up. 

Proof. By assumption, limj^^^^oo \Pv — PtAc^iu ) — 0- Let 77 G A arbitrary. 
Thanks to the maximum principle and to A{d/S.) C Up'. 

\\PMiv)) - PMm\ ^ max \\PMiO) - PMm\ 

< sup \\P,{z) - P^{z)\\ -^0. 

z&Up 

The same argument shows that P^ converges uniformly in the polynomial hull of 
Up (we shall not need this). □ 
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Next, suppose that we have some family of analytic discs Ag, with s a small 
parameter, such that UsAs{A) contains an open set in C", for instance a one- 
sided neighborhood at p G M. Then {P,y)i^(zjq converges uniformly on ^s(A) 
and a theorem due to Cauchy assures that the limit is holomorphic in the interior 
of Us As (A). It then follows that / extends holomorphically to the interior of 
U,A,(A). 

Remarkably, this short argument based on an application of the approximation 
Theorem 5.2(111) shows thao 

In order to establish local holomorphic extension of CR 
functions, it suffices to glue appropriate families of analytic 
discs to CR manifolds. 

In the sequel, the geometry of glued discs will be studied for itself; thus, it will 
be understood that statements about holomorphic or CR extension follow imme- 
diately; elementary details about continuity of the obtained extensions will be 
skipped. 

2.10. Lewy extension. Since M is globally minimal, there exists a point p at 
which TpM = T^M + [T^M,T^M]. Granted Lemma 2.2, holomorphic ex- 
tension to one side at such a point p has already been proved in Theorem 1.18. 
Nevertheless, we want to present a geometrically different proof that will produce 
preliminaries and motivations for the sequel. 

Since T^M = ReT^'^M = ReT^'^M, we have equivalently 
[r^'°M,r°'^M] (p) <^ C ^ T^M, namely the intrinsic Levi form of M 
at p is nonzero. In other words, there exists a local section L of T^'^M with 
L{p) / and [L,T^ (p) C (X" T^M. After a complex linear transformation 
of TpM, we may assume that L{p) = After removing the second order 

pluriharmonic terms, there exist local coordinates {zi, z' ,w) vanishing at p such 
that M is represented by 

V = -zzi + 0(|zi|2+") + 0{\z'\) + 0{\z\\u\) + 0{\u\^). 

The minus sign is set for clarity in the diagram of §2.12 below. We denote by 
ip{zi, z' ,u) the right hand side. Let ei > be small. For e satisfying < e ^ ei, 
we introduce the analytic disc 

A,[Q) := {eil-O,0',Ue{C) + iVe{C)) 

with zero z' -component, with zi -component equal to a (reverse) round disc of 
radius e centered at 1 G C and with u-component Ue satisfying the Bishop-type 
equation: 

C/,(e^^) = -Ti [ip{eil--),0',Uei-))] {e^'). 



This is the so-called Method of analytic discs ; d techniques are also powerful. 
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According to Theorem 3.7(rV), a unique solution [/^(e*^) exists and is C^'""*^ 
with respect to (e*^,e). Since Ti(V')(l) = by definition, we have Ue{l) = 
and then Ve := Ti{Ue) also satisfies ^^(l) = 0. Consequently, ^^(l) = 0. By 
applying Ti to both sides of the above equation, we see that the disc is attached 
to M: 

K(e*^) = (^(e(l-e*^),0',[/e(e^^)). 

We shall prove that for ei sufficiently small, every disc ^^(A) with < e ^ ei 
is not tangent to M at p. We draw two diagrams: a 2-dimensional and a 3- 
dimensional view. In both, the w-axis is vertical, oriented down. 



• M M, 

\ AAdA)/ 












p = Ail) 


p = A(i) ae y-) 



Nontangency of a small disc to the paraboloid v = ~zi 



Just now, we need a geometrical remark. Let A £ O (A) nC^ ( A) be an arbitrary 
but small analytic disc attached to M with ^(1) = 0. We use polar coordinates to 
denote ( 



r e 



ie 



C dA 




A 



Hi) 



AiO) 



Ail)' 



Direction of exit of an attaclied analytic disc 




The holomorphicity of A yields the following identities between vectors in TpC": 



• / if) \ 



dA 
dr 



(r) 



OA 
9C 



(C) 



The multiplication by i (or equivalently the complex structure J) provides an 
isomorphism TpC^'/TpM TpM/T^M; in coordinates, TpC^/TpM ~ ]R„, 
TpM/T^M ~ M„ and J sends M„ to M^. It follows that |^(1) is not tangent to 
M at p if and only if ^(1) is not complex tangent to M at p. 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



171 



Coming back to A^, we call the vector 



^(l)modrpM 



dr 



(1) mod TpM 



the exit vector of A^. By differentiating Vg = ip at 9 = 0, taking account of 
dip{0) = 0, we get ^(1) = 0. So only the real part ^(1) of ^(1) may be 



nonzero. 

Lemma 2.11. Shrinking ei if necessary, the exit vector of every disc A^ with 
{) < e ^ El is nonzero: 

Proof. The principal term of is —zizi. We compute first: 

2 + 



Ti [-Zi(C)Zi(C)] =Ti 
1 



i 

Proceeding as carefully as in Section 3(IV), we may verify that 

Ue{e'') = -Ti [-Zi(C)Zi(C) + Remainder] {e'' 



with a C remainder satisfying ||f^e||^ q ^ Ke for some quantity K > 0. 
So^(l) = -2e2 + 0(e2+") /o. ' □ 



2.12. Translations of a nontangent analytic disc. We now fix e with < e ^ ei 
and we denote simply by A the disc A^. So the vector 

|^(l) = He,0',-2.2 + O(e2+-)) 

is not tangent to T^M = {f = u = 0} at the origin. Furthermore, it is not tangent 
to the (2n — 2) -dimensional sub-plane {yi = v = 0} of TpM = {v = 0}. 

We now introduce parameters of translation x\ G M, S C"~^ and G M 
with jx^l, 1, \uo\ < 6i, where < 6i << s. The points in M of coordinates 

{xi,ZQ,uo + iip{xi,ZQ,uo)) 

cover a small (2n — 2) -dimensional submanifold Kp with TpKp = {yi = v = 0} 
transverse to the disc boundary Ae((5A) at p that we draw below. 
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Nontangency at of the disc boundary Ae{dA)to {u = 0} 



To conclude the proof of one-sided holomorphic extension at the Levi nonde- 
generate point p, it suffices to deform the disc A^o^^i^^^^ so that its distinguished 
point A,j.o Mp(l) covers the submanifold Kp, namely 

(2.13) ^^o^^,_„j,(l) = {x'l,4,uo + iip{x1,z'o,uo)) . 

This may be achieved easily by defining 

(Zi^,o(C),^yC)) := (ei(l-C) + x?,4) 
and by solving the Bishop-type equation: 

(2-14) C/,o,,,,,„(e*^) =no-Ti [(^(Zi^,o(-),^;,(-),t/.o (e*') 

for the M-component of the sought disc A^o Thanks to Theorem 3.7(IV), the 

solution exists and is C^ ""*^ with respect to all the variables. We finally define the 
u-component of A^o^/^^^^: 



(2.15) 



Applying Ti to (2.14), we see that this disc is attached to M; also, putting e* ^ := 1 
in (2.14) and in (2.15), we see that (2.13) holds. Geometrically, the (2n — 2) added 
parameters (x?, z'q,uo) correspond to translations in M of the original disc A^^. 



Translates of the disc 




exit vector 
- 1^(1) not tangent to M 




Translations of an attached analytic disc 
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Define the open circular region Ai := {C G A : |C — 1| < Si} around 1 in tlie 
unit disc. Then we claim that shrinking (5i > if necessary, the set 

{'^x'i,z'g,uoiO : C G Ai, |x?| < 6i, 141 < 5l, \uo\ < ^l} 

contains a one-sided neighborhood of M atp = Aq q^q{1). Indeed, by computa- 
tion, one may check that the 2n vectors of TpC" 

are linearly independent; geometrically and by construction, the first (2n — 1) of 
these vectors span TpM and the last one is linearly independent, since by con- 
struction the exit vector of is nontangent to M at p. □ 
Incidentally, we have proved an elementary but crucial statement: by "translat- 
ing" (thi^ough a suitable Bishop-type equation) any small attached disc whose exit 
vector is nonzero, we may always cover a one-sided neighborhood. 

Lemma 2.16. If a small disc A attached to a hypersurface M satisfies ^(1) 
r^^j^^M, or equivalently —^(1) T^^^^M, then continuous CRfimctions on M 
extend holomorphically at A{1) to the side in which points the nonzero exit vector 
^lt(l) = -|F(l)- 

Of course, the choice of the point 1 G 9A is no restriction at all, since after a 
Mobius reparametrization, any given point Co G dls. becomes 1 G 9A. 

2.17. Propagation of holomorphic extension. The Levi form assumption 
TpM = T^M + [T^M, TpM] was strongly used to insure the existence of a disc 
having a nonzero exit vector at p. But if a disc A is attached to a highly degenerate 
part of M, for instance to a region where the Levi form is nearly flat, the disc A 
might well satisfy |f (Co) G r^(^„)M (or equivalently, -|^(Co) G r^(Co)M), 
for every Co G 9A. Then we are stuck. 

To go through, two strategies are known in the literature. 

• Devise refined pointwise "finite type" assumptions insuring the existence 
of small discs having nonzero exit vector at a given central point. 

• Devise deformation arguments that propagate holomorphic extension 
from Levi nondegenerate regions up to highly degenerate regions. 

Unfortunately, the first, more developed strategy is unable to provide any proof 
of Theorem 2.6. Indeed, a smooth globally minimal hypersurface may well con- 
tain large Levi-flat regions, as for instance {{z, G : v = ro(x)} with a C°° 
function w satisfying w{x) = for x ^ and w{x) > for x > (to check 
global minimality, proceed as in Example 3.10); Theorem 4.8(111) shows that a 
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Levi-flat portion Mlf of a hypersurface M is locally foliated by complex (n — 1)- 
dimensional submanifolds; the uniqueness in Bishop's equatioi{3 then entails that 
every small analytic disc A £ 0{A) n C^(A) with A{dA) C Mlf must satisfy 
A{dA) C S, where S C Mlf is the unique local complex connected (n — 1)- 
dimensional submanifold of the foliation that contains ^(1); then the uniqueness 
principle for holomoiphic maps between complex manifolds yields A{A) C S; 
finally, -^{(o) £ T^^iCo)^ = ^l(Co)^ ^^^^ vector tangential to M at every 

For this reason, we will focus our attention only on the second, most powerful 
strategy, stalling with a review. 

After works of Sjostrand ( HHS 19821 |Sjl982a[ |Sjl982b[ ) on propagation of 



singularities for certain classes of partial differential operators, of Baouendi 
Chang-Treves IIBCT1983II . and of Hanges-Treves IIHT1983II . Trepreau |Trpl990| 



showed that the hypoanalytic wave-front set of a CR function or distribution 
propagates along complex-tangential curves. The microlocal technique involves 
deforming T*A/ inside conic sets and controlling a certain oscillatory integral 
called Fourier-Bros-Iagolnitzer (FBI) transform. In 1994, Baouendi-Rothschild- 
Trepreau MB RT 19941 showed how to deform analytic discs attached to a hyper- 
surface in order to get some propagation results (however. Theorem 2.7 which 
appeals in |Trpl990[ is not formulated in IIBRT1994II ). Then Tumanov IITul994all 



showed how to deformation discs attached to generic submanifolds of arbitrary 
codimension and provided extension results that cannot be obtained by means of 
the usual microlocal analysis. 

Until the end of Section 4, our goal will be to describe and to exploit this 
technique of propagation. The geometric idea is as follows. 

As in Theorem 2.7, assume that holomorphic extension is aheady known to 
hold in a one-sided neighborhood uj^ at some point q G M. Referring to 
the diagram after the main Proposition 2.21 below, we may pick a disc A with 
A{—1) = q. Then a small part of its boundary, namely for e*^ neai^ —1, lies in lo^. 
If the vector §^(1) is not complex tangential at the opposite point p = A{1), it 
suffices to apply Lemma 2. 16 just above to get holomorphic extension at p, almost 
gratuitously. On the contrary, if §f (1) is complex tangential at p, we may well 
hope that by slightly deforming M as a hypersurface which goes inside 
a bit, there exists a deformed disc A^ attached to with again A^{1) = pthat 
will be not tangential: —^^(1) ^ Tj^d^^i^M. Then a translation of the disc A^ as 
in Lemma 2.16 will provide holomorphic extension at p. 



A more general property holds true (see |Trpl990| ITul994ai IMP2006bll ): every 
small attached disc is necessarily attached to a single (local or global) CR orbit; here, E 
is a local orbit, whence A{dA) C S. 
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2.18. Approximation theorem and chains of analytic discs. To prove Theo- 
rem 2.7, we first formulate a version of the approximation theorem which is app- 
propriate for our purposes. 

Lemma 2.19. ( ||Tul994a|| ) For every p ^ M, there exists a neighborhood Up of p 
in M such that for every q G Up, for every one-sided neighborhood Q,^ of Up at 
q, there exists a smaller one-sided neighborhood uj^ C VL^ of Up at q such that 
tlw following approximation property holds: 

• for every F G C^{M U 0^) which is CR on M and holomorphic in Q.^, 
there exists a sequence of holomorphic polynomials {Py{z))v(^^ such that 

= lim,,^oo \Py - /llcO(C/pUa;±)- 

The proof is an adaptation of Theorem 5.2(111). It suffices to allow the maxi- 
mally real submanifolds A„ C M be slightly deformed in (7^. With a control of 
the smallness of their norm, one may insure that they cover not only Up but 
also uj^ . Further details will not be provided. 

To establish local holomorphic extension of CR functions, it 
is allowed to glue discs not only to M but also to previously 
constructed one-sided neighborhoods. 

Pursuing, we formulate a lemma and a main proposition. 

Lemma 2.20. ( IITul994all ) Let p £ M and let Up be a neighborhood ofp in M, 
arbitrarily small. For every q G Ocr{M,p) and every small e > 0, there exist 
£ £ Nwithi = 0(l/e) and a chain of C"^'""'^ analytic discs A^,A^,... ,A^~^,A^ 
attached to M with the properties: 

• ^^(—1) G Up, i.e. this point is arbitrarily close to p; 

• A\l) = A^{-1), A^{1) = A^{-1), A^-\l) = A^-l); 

• A'{1) = q; 

• ll^''llci>o(A) ^ ^'f^^ k = 1,2, . . . 

• each A^ is an embedding A — > C". 




String of analytic discs approximating a CR curve 
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Such a chain of analytic discs will be constructed by approximating a complex- 
tangential curve that goes from q to p, using families of discs Bq^n^^tiC) to be 
introduced in a while. The above lemma is essentially obvious, whereas the next 
proposition constitutes the very core of the argument. 

Proposition 2.21. niBRT1994l[Tul994all ') (Propagation along a d\sc)_Let A be 

a small C^'"^" analytic disc attached to M which is an embedding A — > C^. 
If C'(j^{M) extends holomorphically to a one-sided neighborhood at the 

point A{—1), then it also extends holomorphically to a one-sided neighborhood 
at A[\). With more precisions'. 

• if the exit vector —^(1) '■5' not tangent to M at A{\), extension holds to 
the side in which points —^(1): this is already known, by Lemma 2.16; 

• if the exit vector —^(1) is tangent to M at A{1), there exists an arbi- 
trarily small deformation A'^ of A with A'^{1) = A{1) having boundary 
A'^{d^) contained in MU w^^^ -^^ such that the new exit vector — ^^(1) 

is not tangent to M at A'^{\); then by translating A'^ as in Lemma 2.16, 
holomorphic extension holds at A{1). 




Perturbation of the exit vector 



Indeed, thanks to the flexibility of the solutions to the parametrized Bishop 
equation provided by Theorem 3.7(IV), we can easily, as in Lemma 2.16, add 
translation parameters {x^, Zq,uq) to a slightly deformed disc A^ attached to M U 
uj'^f-.x and then A'^a i (^i) covers a small one-sided neighborhood of M at 

^(1) = A^(\), thanks to the crucial condition -^(1) / 0. We shall not copy 
the details. 

We claim that the proposition ends the proof of Theorem 2.7. By assumption, 
C^^(M) extends holomorphically to a one-sided neighborhood at p. The 

closure uj^ contains an open neighborhood C/p of p. Let q G Ocr{M,p) and 
construct a chain of analytic discs from g up to a point p' G Up. The endpoint 
p' = A^{—1) of the chain of analytic discs being arbitrarily close to p, hence 
in Up, holomorphic extension holds at A^{—1). We then apply the proposition 
successively to the discs A^ , , . . . , A^ and deduce holomorphic extension at q. 
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We now explain Lemma 2.20. To approximate a complex-tangential curve, it 
suffices to construct families of analytic discs that ai^e essentially directed along 
given vectors Vq G T^M. 

Lemma 2.22. For every point q £ M and every nonzero complex tangent vec- 
tor Vq G TqM\{0}, there exists a family of C'^'°^~^ analytic discs Bq^^^^tiC) 
parametrized by t £M with \t\ < ti, for some ti > 0, that satisfies: 

. 5,,.,,t(9A) c M; 

• Q = 5g,^„t(i); 

• ll^9.''9.*llci>o(A) ^ y^t, for some K > 0. 

Proof. In coordinates centered at q, represent M by f = ip{z, u) with (^(0) = 
and dip{{)) = 0. The vector Vq G T^M = = 0} has coordinates (ig,0) for 
some nonzero Za G C"^ ^. Introduce the family of analytic discs 

Bq,.q,t{0 ■.= {tZq{l-C)/2,Wt{0), 

where the real part Ut of Wt is the unique C^'""" solution of the Bishop-type 
equation: 

Ut{e^') = -J^[p{tzq{l - ■)/2,Ut{-))]{e^% 

Proceeding as carefully as in Section 3(IV), we may verify that the assumption 
d</j(0) = implies that ||Wf ||^ q = 0(|tp). Then it is obvious that Vq = {zq, 0) = 

We now complete the proof of Lemma 2.20. Any point q G Ocr{M,p) is 
the endpoint of a finite concatenation of integral curves of sections L of T'^M. It 
suffices to construct the chain of discs for a single such curve exp(tL)(p). Af- 
ter multiplying L by a suitable function, we may assume that q is the time-one 
endpoint q = exp(L)(p). 

Moving backwards, we start from q£ := q, we define A^{Q := 
Bqt-L{gc),i/eiC) and we set qi_i := Sg, -L{g,),i/K-1)- Clearly, 
qe-i = qe — J L{qi) + 0(;p-). Starting again from qe-i, we again move 
backwards and so on, i.e. we define by descending induction: 

• ^^=(0 := i?,„_Lfe),i/KC); 

• qk-i := Sgfc -Lfc),i/^(-l), 

until k = 1. Since g^-i = Qk — j L{qk) + 0{jz)fork = 1, the sequence of 

points qk is a discrete approximation of the integral curve of L, hence the endpoint 
go = A^{—1) is arbitrarily close to p, provided I is lai^ge enough. Finally, by 
construction ||A''||i,o = 0(4). □ 
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The proof of the main Proposition 2.21 does not use special features of hy- 
persurfaces. For this reason, we will directly deal with generic submanifolds of 
arbitrary codimension, passing to a new section. 

§3. TUMANOV'S THEOREM, DEFORMATIONS OF BISHOP DISCS 
AND PROPAGATION ON GENERIC MANIFOLDS 

3.1. Wedges and CR-wedges. Assume now that M is a connected generic sub- 
manifold in C" of codimension 1 and of CR dimension m = d — n ^ 1. The 
case d = I corresponds to a hypersurface. The notion of local wedge at a point p 
generalizes to codimension d^ 2 the notion of one-sided neighborhood at a point 
of a hypersurface. 

More briefly that was has been done in Section 4(111), a wedge may be defined 
as follows. Choose a d-dimensional real subspace Hp of TpC" satisfying TpC" = 
TpHp © TpM and a small convex open salient truncated cone Cp C Hp with 
vertex p. Then a local wedge of edge M at p is: 



This is not yet the most effective definition. Up to shrinking open sets and 
pai^ameter spaces, all definitions of local wedges will coincide. Concretely, the 
wedges we shall construct will always been obtained as unions of small pieces of 
families of analytic discs partly attached to M. So we formulate all the technical 
conditions that will insure that such pieces of discs cover a wedge. 

Definition 3.2. A local wedge of edge M at p is a set of the form: 



where, t G M'^"^ is a rotation parameter, ti > is small, s E ]^2m+a!-i ^ 
translation parameter, si > is small, 0i > is small, ri < 1 is close to 1 and 
^i,s(C)' with C G A, is a parametrized family of C^'""*^ analytic discs satisfying: 

• Atfl{l) = p for every t; 

• the boundaries At,s{dA) are partly (sometimes completely) attached to 
M, namely At^s{e'^) G M, at least for 16*1 ^ ^; 

• for every fixed t, the mapping (s, e*^) ^ ^^^^(e*^) is a diffeomorphism 
from < si} X {\9\ < ^i} onto a neighborhood of pin M; 

• the exit vector — (1) is not tangent to M at p, namely it has 
nonzero projection proj TpC"/TpM{~dAtfl/dr{l)) onto the normal space 



W{Up, Cp):={q + c: q€ Up, c e Cp}. 




TpCJ'/TpM to M at p; 
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• choose any lineai" subspace Hp of TpC" satisfying TpHp(BTpM = TpC", 
so that Hp ~ TpC/TpM, denote by proj : TpC Hp the projec- 
tion onto Hp parallel to TpM, define the associated exit vector 

ex(Ai,o) := proiH^{-^il))e Hp 

and the associated normalized exit vector n-ex(Af o) := 
ex{Atfl) /\6x{Atfi)\; then the rank at t = of the mapping 

should be maximal equal to d — 1. 




The last, most significant condition means that v\-e\[Atfl) describes an open 
neighborhood of n-ex(ylo,o) in the unit sphere S"^"^ C W^. This is of course 
independent of the choice of Hp. Then, fixing s = and ^ = 0, as the rotation 
parameter t G W^~^ varies with \t\ < ti, and as the radius r with ri < r < 1 
varies, the curves Atfl{r) generate an open truncated (curved) cone in some d- 
dimensional local submanifold transverse to M at p. Finally, as the translation 
parameter s varies, the points ^^^^(re*^) describe a (curved) local wedge of edge 
M at p. 

Lemma 3.3. Shrinking ti > 0, si > 0, 9i > and 1 — ri > if necessary, 
the points ofWp are covered injectively: ^^^^(re*^) = At',s'{r'e^^ ) if and only if 
t = t', s = s',r = r' and 9 = 6'. 

This property follows directly from all the rank conditions. It will be useful to 
insure uniqueness of holomorphic extension (monodromy). 



Definition 3.4. (IITul990[|Trpl990[) A local CR-wedge of edge M at p of dimen- 



sion 2m + d + e, with 1 ^ e ^ d, is a set Wp ' defined similarly as a local 
wedge, but assuming that the rotation parameter t belongs to M^"^ and that the 
rank of the normalized exit vector mapping 
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is equal to e — 1. 

Then, fixing s = and ^ = 0, as the rotation parameter t G M*^"^ with |t| < ti 
varies, and as the radius r with ri < r < 1 varies, the curves Atfl{r) describe an 
open truncated (curved) cone in some e-dimensional local submanifold transverse 
to M at p. These intermediate wedges of smaller dimension will play a crucial 
technical role in the sequel. 

The case e = 1 deserves special attention. A CR-wedge is then just a manifold 
with boundary Mp with dim Mp = 1 +dim M that is attached to M at p, namely 
there exists an open neighborhood Up of p in Ad with Up C dMp . If in addition 
M has codimension d = 1, we recover the notion of one-sided neighborhood. It 
is clear that after a possible shrinking, every C^'"^'^ manifold with boundary Mp 
attached to M at p may be prolonged as a local C^'""*^ generic submanifold Mp = 

C R 1 

Wp ' containing a neighborhood of p in M (as shown in the right diagram). 




Prolongation of a CR-wedge as a generic submanifold 



By elementary differential geometry, for e ^ 2, it may be verified that a local 
CR-wedge Wp^''^ of edge M at p defined by means of a C^'"^*^ family of discs, 
namely 

W^^'' := {At,s{re'^) : |t| < h, \s\ < si, \9\ < 9i, n < r < l}, 

may also be prolonged as a local generic submanifold A4p of dimension 2m+d+e 
containing a neighborhood of p in M. The left diagram is an illustration; in it, 
e = d = 2, so that M of codimension 2 is (unfortunately for intuition) collapsed 
to p. 

However, the smoothness of Mp can decrease to C^'""*^, because as in 
a standard local blowing down {zi,Z2) ^ {zi,ziZ2), the rank of the map 
{r,9,s,t) ! — > At^s{re^^) degenerates when r = 1, since the discs (partial) 
boundaries |ylt^s(e*^) : |^| ^ ^} are constrained to stay in M. For techni- 
cal reasons, we will need in the sequel the existence of a prolongation Aip that is 
Q2,a-o ^Yso when e ^ 2. The following modification of the definition of Wp^''^ 
insures the existence of a C^'"^'^ prolongation A4p. It will be applied implicitly 
in the sequel without further mention. 
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So, assume e ^ 2, let At^s be a family of discs as in Definition 3.4 with 
ex(^o,o) / in TpC'^/TpM and t ^ n-ex(^t,o) of rank e - 1 at t = 0. 
Fix t := and define firstly 

W^^'i := {Ao^re"^) : \s\ < si, \9\ < 9i, n < r < l}. 

This is a manifold with boundary attached to M at p. So there is a small 
prolongation A^p D Wp^"^. 

Choose t small with At^ having exit vector nontangent to A4p at 
p. Introduce a one-parameter family M^, a € M, |(t| < ai, ai > 0, of 
generic submanifolds obtained by deforming slightly M inside A4p near p, with 

M„ C MU Wp^'^ for a ^ 0. The are "translates" of M in A^^ near- p. To 
understand the process, we draw two diagrams in different dimensions. 




Thanks to the flexibility of Bishop's equation (Theorem 3.7(IV)), the At^s may 
be deformed as a C^'""*^ family At^s,a and we define secondly 

:= {At^,^^{re'^) : |s| < si, < a < ai, \9\ < 0i, n < r < l}. 

Then this set constitutes a local CR-wedge of dimension 2m + d + 2 with edge 
M at p. Letting a run in {—ai , cji) above, we get instead a certain manifold with 
boundary attached to M-p that may be extended as a C^.o-o generic submanifold 

A4p of dimension 2m + d + 2. Then W^^'^ is essentially one quarter of ^Ap. 
We neither draw Wp ' nor Wp in the right diagram above, but the reader sees 
them. By induction, using that t r\-ex{Atfl) has rank e — 1 at t = 0, we get 
the following. 

Lemma 3.5. After a possible shrinking, a suitably constructed local C^.a-o 
wedge Wp^'^ of edge M at p may be prolonged as a local c2,«-o g^yi^yif- ^^1,. 
manifold Mp of dimension 2m + d + e containing a neighborhood ofp in M. 

In the sequel, similar technical constructions will be applied to insure the exis- 
tence of C^'""*^ prolongations Aip D W^^'*^ without further mention. 
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3.6. Holomorphic extension of CR functions in higher codimension. In 1988, 
Tumanov IITul988ll established a theorem that is nowadays celebrated in Several 
Complex Variables. Recall that by definition, M is locally minimal at p if the 
local CR orbit Oq1^{M,p) contains a neighborhood of p in M. Equivalently, M 
does not contain any local submanifold passing through p with CRdim N = 
CRdim M and dim N < dim M. 



Theorem 3.7. ( IITul988l IBRT 19941 |Trpl996| ITul998[ IBER1999II ) Let M be a 

local C^'" generic submanifold o/C" and let p G M. If M is locally minimal at 
p, then there exists a local wedge Wp of edge M at p such that every f G C^j^(M) 
possesses a holomorphic extension F G OiWp) H C^{M U Wp) with F\m = /■ 

Conversely, recall that according to Theorem 4.41(111), if M is not locally min- 
imal at p, there exists a local continuous CR function that is not holomorphically 
extendable to any local wedge at p. 

Since the literature aheady contains abundant restitution^^, we will focus in- 
stead on propagation phenomena that are less known. 



In 1994, as an answer to a conjecture formulated by Trepreau in |Trpl990|, 
it was shown simultaneously by Joricke and by the first author that Tumanov 's 
theorem generalizes to globally minimal M. The preceding statement is a direct 
corollary of the next. Its proof given in MMe 19941 IJo 19961 used techniques and 
ideas of Tumanov IITul988[|TuT994al and of Trepreau |Trpl990[. 



Theorem 3.8. ( IIMel994[|Jol996ll ) Let M be a connected C^'" generic submani- 
fold ofC"". IfM is globally minimal then at every point p G M, there exists a local 
wedge Wp of edge M at p such that every continuous CR function f G C^j^{M) 
possesses a holomorphic extension F G 0(Wp) Pi C^{M U Wp) with F\m = /■ 

With this statement, the extension theorem for CR function has reached a final, 
most general form. Philosophically, the main reason why it is true lies in the 
propagation of holomorphic extendability along complex-tangential curves. This 
was developed by Trepreau in 1990, using microlocal analysis. 



Theorem 3.9. (|Trpl990 1) Let M be a connected C°° generic submanifold o/C". 
IfC^j^{M) extends holomorphically to a local wedge at some point p G M, then 
at every point q G Ocr{M,p), there exists a local wedge Wq of edge M at q 
such that every f G C^^(M) possesses a holomorphic extension F G 0{Wq) H 
C^{MuWq)with F\m = f. 



17 



We recommend mostly the two elegant presentations |Trpl996| and lITu 19981 : other 



references are: I B RT 1 9941 IBER 19991 . Excepting a conceptual abstraction involving the 
implicit function theorem in Banach spaces and the conormal bundle to AI, the major 
arguments: differentiation of Bishop's equation and a crucial correspondence between an 
exit vector mapping and an evaluation mapping defined on the space of discs attached to 
M, the geometric structure of the proof is exactly the same in the original article lITu 19881 
as in the restitutions. 
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Before surveying the original proof ( HMe 1 9941 IJo 1 996t ) of this theorem in Sec- 
tion 5, we shall expose in length a substantially simpler proof of Theorem 3.8 that 
was devised by the second author in IIPo2004ll . This neat proof treats locally 
and globally minimal generic submanifolds on the same footing. It relies partly 
upon a natural deformation proposition due to Tumanov in IITul994al . but without 
any notion of defect of an analytic disc, without any needs to control the varia- 
tion of the direction of CR-extendability, and without any partial connection, as 
in ]Trpl990|lTul994a[|Mel994ll . The next paragraphs and Section 4 are devoted 



to the proof of this most general Theorem 3.8. 

Example 3.10. A globally minimal manifold may well be not locally minimal at 
any point. 

Indeed, let x : M ^ M+ be C°° with x = on (-oo, 1], with x > on 
(1, +oo) and with second derivative Xxx > on (1, +oo). Consider the generic 
manifold M of C'^ defined by the two equations 

vi = x{x), V2 = x(-x), 
in coordinates {x + iy,ui + ivi,U2 + i ^2)- Then T^'^M is generated by 



OZ OWi OW2 

In terms of the four coordinates (x, y, ui, M2) on M, the two vector fields gener- 
ating T^M ai-e 

8 

:= 2ReL = — , 

ox 

-2ImL = | + x.(x)A_^,(_^)^ 

(we have dropped Xx{x) — Xxi—x) in 2 Re L). Denote by L° the system 
of these two vector fields {L^ , L^} on ~ M and by L the (M'^)-hull of L^. 
Observe that the Lie bracket 

[L^L^] = Xxx{x) + Xxx{-x) 

is zero at points p = (xp, yp, Uj*, u^) with — 1 < Xp < 1, has non-zero 
component at points p with Xp < —1 and has non-zero -component at points 
p with Xp > 1. It follows that the local L-orbit of a point p with Xp < —1 is 
{ui = u^}, of a point p with — 1 < Xp < 1 is {ui = u^, U2 = and of a point 
Xp with Xp > 1 is {^2 = ^2}. Also, observe that since the vector field = 
belongs to L, the local L-orbit of any point p = (xp, yp,u\,u^) contains points of 
coordinates (xp + t, yp, u\, u^), with t small. We deduce that the local L-orbit of 
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points p with Xp = 



-1 or = 1 are three-dimensional, hence in conclusion: 



( Up n {ui = <} 

Up n {Ul = u\, U2 

^ Up n {u2 = } 



if Xp ^ 



if 



1, 

1 < Xp < 1, 



if Xp ^ 1, 



where Up is a neighborhood of p in M. So L is nowhere locally minimal. 
Lemma 3.11. The system L is globally minimal. 

Proof. We check that any two points p, g G M"^ are in the same L-orbit. Using 
the flow of = ^ and then the flow of on {x = 0}, the original two 
points p and q may be joined to points, still denoted by p = (0, 0, Uj', Ug) and 
q = (0, 0, u^, M2)' having zero x-component and zero y-component. 

We claim that the global L-orbit 0^(1^^,^) of every point p = (0, 0, u^, U2) 
contains a neighborhood of p in M^. Since the two-dimensional plane {x = y = 
0} is connected, this will assure that any two points p = (0,0, u^jul) ^iid q = 
(0, 0, ul, U2) ai^e in the same L-orbit. 

Indeed, by means of every point p = {0,0, u^jU?,) is joined to the two 
points p~ := (—1, 0, u^, u^) and p+ := (1, 0, u^, u^). Let Up- and Up+ be small 
neighborhoods of p~ and of Denote by H~ := {ui = } n Up- and by 
:= {u2 = n Up+ small pieces of the three-dimensional local L-orbits of 
and of p~^. 



M ^ 




Verification that L'"^(0) = 



The flow of L = ^ being a translation, we deduce: 

eML'){H~) = {ui = uP} nUp, 
exp(-Li)(if+) = {U2 = u^} n Up, 

where Up is a small neighborhood of p in M ~ M^. Observe that the two 3- 
dimensional planes are transversal in TpM.'^. Lemma 1.28(111) yields: 

L"-(p-)Drp-o[-(p-) = ^i = <}, 

L--(p+) D rp+0[-(p+) = ^2 = nf}. 
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By the very definition of L"", we necessarily have: 

L"-(p) D exp(L^),(L''^^(p-)) +exp(-Li),(L"-(p+)) 

= {Ul = u[} + {U2 = U2} 

= TpM^, 

so L™^(p) = TpM.^. Consequently, Oi^(K^,p) contains a neighborhood of 
(0,0,ii?,uf) inM''. □ 



3.12. Setup for propagation. Let M be connected, generic andC^'", let g G M 
and let Wq ' be a CR-wedge of dimension 2m + d + e at q, with 1 ^ e ^ d. For 
short, we will say that C^^(M) extends to be CR on ^'"^ if for every / G C^^, 
there exists F G C^^iM U ^''') with F\m = /■ 

Theorem 3.13. Let e G N with 1 ^ e ^ d. Assume that C^j^{M) extends to 

C Ft e 

be CR on a CR-wedge Wp ' of dimension 2m + d + e at some point p G M. 
Then for every q G Ocr{M,p), there exists a CR-wedge Wq^'^ at q of the same 
dimension 2m + d + eto which C^j^{M) extends to be CR. 

In the case e = d, we recoveiF^ Trepreau's Theorem 3.9, since continuous CR 
functions on an open set of C" (here a usual wedge) are just holomorphic. If M is 
globally minimal, then extension holds at every q G M. Notice that this statement 
covers the propagation Theorem 2.7, stated previously in the hypersurface case 
d = e = l. 

Let us start the proof. Through a chain of small analytic discs, every q G 
Ocr{M,p) is joined to a point p' arbitrarily close to p: indeed. Lemma 2.20 and 
its proof remain the same in arbitrary codimension d ^ 1. At p', CR extension 
holds, because the edge of Wp ' contains a small open neighborhood Up of p in 
M. To deduce CR extension at q, it suffices therefore to propagate CR extension 
along a single disc, as stated in the next main proposition. 



Classical microlocal analysis was devised to measure the analytic wave front set of a 
distribution in terms of the exponential decay ot the Fourier transform restricted to open, 
conic submanifolds of the cotangent bundle. We suspect that there might exist higher 
generalizations of microlocal analysis in which one takes account of the good decay of 
the Fourier transform on submanifolds of positive codimension in the cotangent bundle. 
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M 



Proposition 3.14. (Propagation along a disc) ( IITul994a[|MP1999L [*]) Let A 
be a small C^.a-o Qjidiyfi^ j/^y^ attached to M which is an embedding A C". 
Let e £ N with 1 ^ e ^ d. Assume that there exists a C^.a-o CR-wedge W^^^^j 
at A{—1) of dimension 2m + d + e to which C^^(M) extends to be CR. Then 
there exists a c2,"-o CR-wedge at A{1) of the sam.e dimension 2m + d+e 

to which C^^(M) extends to be CR. 

With more precisions, the CR-wedge constructed by translating a 

certain family of analytic discs At> having the following properties. Setting p := 
^(1), there exists a C'^'°'~^ family At' of analytic discs, t' £ M.^, \t'\ < t'^, t'l > 0, 
with At'\t'=o = A, with Afil) = p, satisfying At'{e^^) G M for \e\ ^ ^ and 
having their boundaries At/(5A) C M U W^^^^^ for t' belonging to some open 
truncated cone C C W^, such that the exit vector mapping: 



is of maximal rank equal to e at t' = 0, where Hp ~ M.'^ is any linear subspace 
ofTpC^ such that Hp © TpM = T^C", and where proj fjp the linear projection 
parallel to TpM. 

Geometrically, as t' varies, the exit vectors ex(ylt') describe an open cone Cp C 
Hp, drawn in the diagram. 

We claim that this statement covers the second, delicate case of Proposi- 
tion 2.21. Indeed assuming that e = d = I and that the exit vector —§7(1) 
is tangent to M at ^(1), the above proposition includes A in a one-parameter 
family Af whose direction of exit in the normal bundle has nonzero derivative 
with respect to t'. Hence for every nonzero t', the direction of exit of A^i is not 
tangent to M at p. Thus, a non-tangential deformed disc A^ as in Proposition 2.21 
may be chosen to be any Af , with t' / 0. 



B t' 




Proof of Proposition 3. 14. We first explain how to get CR extension at p from the 
family Af , taking for granted its existence. 
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(I) Suppose firstly that the exit vector of A = Aq is non-tangential to M at p. We 
have to restrict the parameter space t' G M"^ to some parameter space t G M*^^^ so 
as to reach Definition 3.4. 

Let us take for granted the fact that the exit vector mapping has rank e at i' = 0. 
Then the normalized exit vector mapping 

R^3t' < — > n-ex(^j,) = ex{At>)/\ex{At')\ e S'^'^ 

has rank ^ e — 1 at t' = 0. So there exists a small piece of an (e — 1) -dimensional 
linear subspace Aq of M"^, parameterized as t' = 4>{t) for some linear map (f), with 
t G W-~^ small, namely \t\ < ti, for some ti > 0, such that t ^ 'C\-ex{A^(j.-^) has 
rank (e - 1) att = 0. 

Setting At := A^{ty we thus reach Definition 3.4, without the translation pa- 
rameter s. 

But proceeding exactly as in the hypersurface case, it is easy to include some 
translation parameter getting a family {Ati)s = Ati g. The proof is postponed 
to the end §3.24. Then the desired family At^s of the proposition is just ^^(j) g, 
shrinking ti > and si > if necessary. 

Lemma 3.15. There exists a deformation At'^g of Afi, with s G M2m+d-i^ j^j ^ 
si, such that: 

• the boundaries ^^/^^(SA) are contained in M U VV^/^^-, and A(/(e*^) G 



Mfor\e\ ^ ^; 



for every fixed t' , themapping (s,e*^) i — > ^^/^^(e*^) is a diffeomorphism 
from {\s\ < si} X {\9\ < 6i} onto a neighborhood ofp in M. 



Therefore, the final family At^s yields a CR-wedge Wp^''^ at p = A{1), as 
in Definition 3.4. The mild generalization of the approximation Theorem 5.2(111) 
stated as Lemma 2. 19 above in the case d = 1 holds in the general case d ^ I 



CR,e 
P 



without modification. Consequently, C^p^{M) extends to be CR on Wj 
(II) Suppose secondly that the exit vector of A = Aq is tangential to M at p. 
Thanks to the fact that the exit vector mapping has rank e a.tt' = 0, for every 
nonzero t'^, the disc is nontangential to M at p. In this case, we fix a small 
tg 7^ and we proceed with ^t'+tj^ just as above. 

In summary, it remains only to construct the family Af having the crucial prop- 
erty that the exit vector mapping has rank e at t' = 0. □ 

3.16. Normal deformations of analytic discs. Thus, we now expose how to con- 
struct Af. We shall introduce a parameterized family Mf of C^'""" generic 
submanifolds by pushing M near A[—l) inside in e independent nor- 

mal directions, e being the number of degrees of freedom offered by W^j-J^^. 
Outside a neighborhood of A{—1), each Mfi shall coincides with M and also 

Mt,\t'=Q = M. 
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We may assume that the point p := ^4(1) is the origin in coordinates {z,u + 
iv) € C™ X in which M is represented hy v = (p{z,u), where ip satisfies 
V?(0) = and d(p{0) = 0. Let t' G W be small, namely < t[, with t[ > 0. 

In terms of graphing equations, the deformation Mf may be represented by 

V = $(z, u, t'), 

with $ G (^2,0-0 defined for \t'\ < t[ satisfying ^{z,u,0) = (p{z,u). The point 
A{—1) has small coordinates n„i + i ip{z^i, We require that the e 

vectors 

$j/^(2;_i,M_i,0), k = l,...,e, 

are linearly independent. There exists a truncated open cone C C with the 
property that 

Mtf C MU WjJ'^), 

whenever t' G C. In fact, we implicitly assume in Proposition 3.14 that the CR- 
wedge based at A(— 1) may be extended as a generic submanifold A^^^_^) 

of dimension 2m + d + e passing through A{—1) so that Mf/ is contained in 
M U A^^(_i), for every < t[. The original CR-wedge W^^^^^ may then be 

viewed as a curved real wedge of edge M which is contained inside M^^^iy 

The starting C^'" disc A{C) = {Z{C),W{C)) with W{C) = {U{C) + i V{C)) is 
attached to M with = 0. Equivalently: 

V{e'') = ^(zie'%U{e^')), 

Uie^') = -J^[^{Z{•),U{■))W)^ 

for every e*^ G OA. Thanks to the existence Theorem 3.7(IV), there exists 
a c2'°-o deformation A^/ of ^, where each AfiC) ■= {Z{C),W{C,t')) with 
Af (1) = p has the same z-componenf^ as A and is attached to Mf , namely: 



(3.17) 




^[z{e''),U{e'',t'),t''^ 
-Ti [^Z{-),U{;t'),t')] ie''), 



for every e*^ G 9A. Observe that W{e^'^,0) = W{e^'^). We then differentiate 
the first line above with respect to t'^ at t' = 0, for /c = 1, . . . , e, which yields in 
matrix notation: 
(3.18) 

V,y\Q) = (z{e''),U{e''),^) (e^^ 0) + (z(e^^), C/(e^^), o) . 



^'^ Since first order partial derivatives Wf^ (C, t'), fc = 1, . . . , e, will appear in a while, 
we do not write the parameter t' as a lower index in J7(C, t') + i V{C,, t'). 
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Also, the discs A^/^ {C, 0) satisfy the linear Bishop-type equation 

C/t.(e*^0) = -Ti [<^u{Z{-),U{-),0)Ut'^{;0)+<^t>^{Z{-),U{-),0)] {e''). 

As a supplementary space to TpM in TpC", we choose Hp := {0} x iM'^ = 
{w = 0,n = 0}. Then ^ro] H^{-dAt'{l)/dr) = -dV{l,t')/dr, which yields 
after differentiating with respect to t'^ at t' = 0: 



d 

(3-19) ^ 



t'=o 



for A; = 1, . . . , e. We will establish that if the local deformations ^■^t' of M 

C Ft e 

inside the CR-wedge W^^J^^ are concentrated in a sufficiently thin neighborhood 
of 1), then the above e vectors —dVfi^/dr{l, 0), = 1, . . . , e, are linearly 
independent. This will complete the proof of the proposition. 

There is a singular integral operator J' which yields the interior normal deriva- 
tive at 1 G dA of any mapping ti = A ^ M*^ which is harmonic in A and 
vanishes at 1 G dA: 

1 r _v{^^^Q _ _dv^ 
vr /__ |e*^ — Ip dr 



(3.20) Jiv):=p.v.- I T-t^,de = --{!) 



The proof is postponed to Lemma 3.25 below. If /i : A — > is C^'" ^ and 
holomorphic in A, we have in addition 

With the singular integral J', we may thus reformulate (3.19): 

Lemma 3.21. Let u,v e C^'°^°(A, M'^) be harmonic in A and vanish atl e dA. 
Then: 

= J' {uv — TiuTiu) . 
In addition, u {and also v) satisfies the two equations: 

:^(n) = -^^(l) and :7(TH = ^(1)- 

Proof. The holomorphic product w := {u + iJiu){v + iJiv) vanishes to second 
order at 1 G dA, so J{w) = 0, hence 

= YieJ{w) = J(uv - TiuTiw). 

The pair of equations satisfied by u is obtained by identifying the real and imagi- 
nary parts of i7(/i) = i where h := u + i Tin. □ 
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Following IITul994all . we now introduce ad x d matrix G of C^'" functions on 
dA defined by the functional equation 

G{e'') = / + Ti [G(-) {Z{.), [/(•), 0)] (e*^). 

Here = (<I*«i)i</<^ is a d x d matrix. Since ^u{z, u, 0) = (y9„(z, u) is small, 
the solution G exists and is unique, by an application of Proposition 3.21(IV). 
Notice that G(l) = /. Applying Ti to both sides, we get Ti G = -G <i>„ + est., 
without writing the arguments. In fact, the constant vanishes, since <l*u(0, 0, 0) = 
ipu{0,0) = 0. So we get: 

TiG = -G^>„. 

We also notice that Vf/^ = Ti U^i^ and Ufi^ = — Ti V^'^. 

Next, we rewrite (3.18) without arguments: ^^'^ = Vf^ — Uf^, k = 1, . . . , e, 
we apply the matrix G to both sides, we replace G by — TiG as well as Uf^ by 
—TiVfi and we let appear a term uv — Tiu Tiv: 



G$,, =Gyt, -G$„C/t, 

= G14, -(TiG)(TiT4,) 

= + (G - m> - Ti(G - /) Ti^. 



Finalljo applying the singular- operator J' and remembering Lemma 3.21, we 
obtain: 

(3.22) j(G<^eJ = J{Vt'J. 

We claim that if the support of the deformation Mj/ is sufficiently concentrated 
near ^(—1), the e vectors J^t'^ = J{G^t'^) G M'^ are linearly independent. 

Indeed, since the deformations Mft are localized near A{—1), we have 
<^t>^{Z{e'^),U{(^^),{)) = 0, except for 16* + 7r| < 6*2, with 6^2 > small. We 
deduce: 



1 r G(e^^)c|..(Z(e*^),C/(e'^),0) 



(3.23) 



J{G^,^) = - / 112 -'^^ 



1 G(-l) 



/ ^,^{Z{e^'),U{e''),^)de. 

J\e+Tv\<eo. 



71" 4 J|e+7r|<02 

Since, by assumption, the e vectors <I>f/ n_i, 0) are linearly independent, the 
linear independence of the above (concentrated) vector-valued integrals follows. 
The proofs of Proposition 3. 14 and of Theorem 3.13 are complete. □ 



2" We can also check that J^(;7t;^ ) = -JiJiVf^) = Wfjl, 0)/96' = 0. Indeed, 
it suffices to differentiate (3.18) with respect to at = 0, noticing that <i>„(0, 0, 0) = 
LPu{0,Q) = 0, that [/(/ ( 1,0) = and that (z,it,0) = for (z,u) near (0,0). 
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3.24. Proofs of two lemmas. Firstly, we check formula (3.20). 

Lemma 3.25. Let u € C^'^(A) {{) < [3 < 1) be harmonic in A, real-valued and 
satisfying u{l) = 0. Then the interior normal derivative ofuatl G dA is given 
by: 



1 

p.v. — 

vr 



n e 



IP 



d9 = p.v. — 



dC. 



Proof. The function h := u + iJu is holomorphic in A and C^'^ in A. Since 
Tu is also harmonic in A, since = (1) + ^ ^^i^)' since the kernel 

|g«f _ i|-2 j-g^j^ jjj^y prove the lemma with u replaced by /i G 0(A) n 
Ci''3(A). 

Let C = re*^ and denote /ii := = |^(1), so that h{C) = (C - + 

0(|C — We remind that, for any (o G dA, by an elementary modification 



of Cauchy's formula, we have p.v. ^ Jq^ 
term {(^ — l)hi provides the main contribution: 



We deduce that the linear 



p.v. 



-2 hi p.v. 



1 



dC 



Thus, we have to prove that the remainder r((^) := h{C,) — {C, — l)hi, which belongs 
to 0{A) n C^'^(A), gives no contribution, namely satisfies J^^ [l-iy^ '^^ ~ ^■ 



Set s(C) 



HO 



(C-i) 



4^. Then s G C(A) is continuous on A\{1} and satisfies 



^ K|C — for some K > 0. We claim that by an application of 

Cauchy's theorem, the integral Jq^ s{C) dC,, which exists without principal value, 
vanishes. 

Indeed, let e with < e << 1 and consider the open disc A(l, e) of radius e 
centered at 1. The drawing of this disc delineates three arcs of A: 



(i) the open aix dA\A{l,£), of length 27r — 2 e; 



We then decompose the integral of s on dA as integrals on the first two ai"cs: 



(ii) the closed arc (9A n A(l, e), of length 2 e; 

(iii) the closed arc (9A(1, e) n A, of length is k, tie. 



I s{C)dC= [ siC)dC+ [ 

JdA JdA\Aa,e) JdL 



s{C)dC. 



IdA JdA\A{l,e) JdAnA{l,e) 

The estimate |s(C)| ^ K |C — insures the smallness of the second integral: 



9AnA{l,e) 



siOdc 
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To transform the first integral, we observe that Cauchy's theorem entails that in- 
tegration of s{C) dC on the closed contour [3A\A(1, e)] U [dA{l,e) n A] van- 
ishes: 

0= / siC)dC+ [ _s{C)dC. 

JdA\A{l,e) JdA{l,e)r\A 
Hence the first integral /qa\ a(i e) replaced by the integral — /^^^^ ^^^-^-^ 

on the third arc. The estimate |s(C)| ^ K |(^ — again insures that this second 
integral is bounded by C2 £^ ■ In conclusion | s{C,) dC, \ ^ (Ci + C2) □ 

Proof of Lemma 3.15. Secondly, we provide the details for the translation of the 
family Af. Let v = ip{z, u) represent M in a neighborhood of p. By assumption, 
AfiC) = {Z{(),W{C,t')) is attached to Mt>, with At'{l) = p. Equivalently, 
the two equations (3.17) hold. Since A = Ati\t'=o is an embedding, the vector 
Vp := ^(1) G TpM is nonzero. As in §2.12, we choose a small (2m + d — 1)- 
dimensional submanifold Kp passing through p with Rvp © TpKp = TpM and 
we parametrize it by s 1-^ {z{s),u{s) + i ip{z{s),u{s))), where s G ]^2m+<i-i 
small, |s| < si, si > 0. Then the translation 

At'AO = {Z{C) + z{s),W{C,t',s)) 
is constructed by perturbing the two equations (3.17), requiring only that 

= {z{s),u{s) +iip{z{s),u{s))). 

This is easily done: 

r V{e'',t', s) = <^{Z{e'') + z{s), U{e'\ t' , s),t') , 

\ U{e^\t', s) = u{s) - Ti + z{s), U{;t', s),t')] {e''). 

The non-tangency of Vp with Kp at p then insures that for every small fixed t', 
the mapping {9, s) 1— > At'^si^^^) is a diffeomorphism onto a neighborhood of p in 

M. ' □ 



§4. HOLOMORPHIC EXTENSION 
ON GLOBALLY MINIMAL GENERIC SUBMANIFOLDS 

4.1. Structure of the proof of Theorem 3.8. Let M be a C^'" globally minimal 
generic submanifold of C". For clarity, we begin by a summary of the main steps 
of the proof of Theorem 3.8. 

(a) Since M is globally minimal, the distribution q 1— >■ T^M must be some- 
where not involutive, namely there must exist a point p & M and a sec- 
tion L of T^'^M defined in an open neighborhood Up of p in M with 
L{p) / such that [L,L\ {p) Tp'°Af ® Tp'^M. 
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(b) Thanks to an easy generaUzation of the Lewy extension theorem (§2.10), 
there exists a manifold Mp attached to M at p with dim Mp = 1+dim M 
to which Cqj^{M) extends to be CR. 

(c) Thanks to the main propagation Proposition 3.14, CR extension to a 
similar- manifold Af J attached to M holds at every point q ^ M = 
Ocr{M,p). 

(d) Since there are as many manifolds with boundary as points in M, it may 
well happen that at some point p £ M which belongs to the edge of two 
different manifolds Mp, and Mp„, the tangent spaces TpMp, and TpMp,, 
are distinct. Refering to the diagram of §4.5 below, we may then imme- 
diately profit of such a situation, if it occurs. 

(e) Indeed, in this case, an appropriate version of the edge-of-the-wedge the- 
orem guarantees that Cqj^{M) extends to be CR on a CR-wedge 
Wp ' at p whose dimension e is ^ 1 + 1 = 2. 

(f) To reason abstractly, let Cmax be the maximal integer e with 1 ^ e ^ d 
such that there exists a point p £ M and a CR-wedge Wp'^''^ at 
p of dimension 2m + d + eto which C^,j^{M) extends to be CR. Thanks 
to the main propagation Proposition 3.14, CR extension to a C^.q-o Q^i- 
wedge yy^^'^''^'^'' holds at every point q£ M = Ocr{M,p). 

(g) If Cmax = d, we are done. Theorem 3.8 is proved. Assuming Cmax ^ 
d — 1, we must construct a contradiction in order to complete the proof. 

(h) Since Cmax is maximal, again because of the edge-of-the-wedge theorem, 
the transversal situation (d) cannot occur; in other words, every point 
p e M that belongs to the edges of two different CR-wedges yy^^'^"^''- 

and W^,^'^"^"" has the property that TpW^^'""^"" = ^pW^,^'^■""^ 

(i) It follows that, as p runs in M, the (2m + d + e) -dimensional tangent 
planes rpW^^'"""""" n TpM glue together and they define a C^'"-° sub- 
distribution KM of the tangent bundle TM, of dimension 2m + emax> 
which contains T'^M. 

(j) Since M is globally minimal, such a distribution p h-> KM{p) must be 
somewhere not involutive, namely there must exist a point p ^ M such 
that [KM, KM] (p) ^ KM{p). 

(k) The c2'°-o CR-wedge W^^'"""'"" may be included in some C^'""" local 
generic submanifold A^p'"^'= passing through p and containing M in a 
neighborhood of p. 

(1) Multiplication by i gives T^Mp"^'''' = KM{p) + i KM{p) and the non- 
degeneracy [KM, KM] (p) ^ KM{p) implies that the Levi-form of 
TWp™'"' is not identically zero at p, namely [T^ Alp™'"', TpTW^™''''] (p) (/L 
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(m) Then a version of the Lewy-extension theorem on conic generic mani- 
folds having a generic edge guarantees that C^j^ {M) extends to be CR on 
a CR-wedge Wj^^'^^'^™'''' of dimension 2m + d+l + emax at p. This new 
CR- wedge is constructed by means of discs attached to M U Wp , 
exploiting the nondegeneracy of the Levi form of Mp'^'^^. This contra- 
dicts the assumption that emax ^ d — 1 was maximal, hence completes 
the proof of Theorem 3.8. 

The remainder of Section 4 is devoted to provide all the details of the proof. 

4.2. Lewy extension in arbitrary codimension. As observed in (a) above, there 
exists a point p G M and a local section L of T^'^M with L{p) / such that 
[L,L] (p) ^C(g)T^M. 

Lemma 4.3. ( l|Wel9821 |BPol982| ) There exists a manifold with boundary 
attached to a neighborhood of p in M with dim Mp = 1 + dim M to which 
C^r{M) extends to be CR. 

We shall content ourselves with only one direction of extension, since this will 
be sufficient for the sequel. Nevertheless, we mention that finer results expressed 
in terms of the Levi-cone of M at p may be found in ||BPol982[|Bol9911 . Any- 
way, all the extension results that ai^e based on pointwise nondegeneracy condi- 
tions as the openness of Levi-cone or the finite typeness of M at a point are by far 
less general than Theorem 3.8, in which propagational aspects are involved. 

Proof. The arguments are an almost straightforward generalization of the proof of 
the Lewy extension theorem (hypersurface case), akeady exposed in §2.10 above. 
Here is a summary. 

By linear algebra reasonings, we may find local coordinates {z, w) G C" x 
vanishing at p with L{p) = ^j^, with M given hy v = ip{z, u), where ip{0) = 0, 
d(p{0) = 0, and with first equation given by 

vi = vi= zizi + 0(|zip+") + 0{\z\) + 0{\z\ \u\) + 0(|n|2), 

where we have split further the coordinates as {zi,z, wi,w), with z G C™^^ and 
w G C^'^. For e > small, we introduce the disc defined by 

MC) := (e(l-C),0,VF,i(C),W^.(C)), 

where VFe(C) = f^e(C) + ^ ^e(C) is uniquely defined by requiring that is at- 
tached to M and satisfies ^e(l) = p. As in §2.10, one verifies that 

-^(I)=2e2 + 0(e2+"). 
or 

Hence the exit vector of at 1 G dA is nontangential to M at p, provided s > 
is small enough and fixed. By translating A^, we construct the desired manifold 
with boundary Afp. □ 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



195 



4.4. Maximal dimension for CR extension. As in §4. 1(f), let emax be the max- 
imal integer e ^ d such that there exists a point p ^ M and a C^'""'' CR-wedge 
Wp^''^ at p of dimension 2m + d + e to which C^j^{M) extends to be CR. By 
the above Lewy extension, we have Cmax ^ 1- Thanks to the main propagation 
Proposition 3.14, it immediately follows that CR extension to a C^'""*^ CR-wedge 
yyCR,em.^ hoWs at cvcry point qe M = Ocr{M,p). If e^ax = d, Theorem 3.8 
is proved, gratuitously. 

Assuming that 1 ^ Cmax ^ d— 1> in order to establish Theorem 3.8, we must 
construct a contradiction. In the sequel, we shall simply denote Cmax by e. 

To proceed further, we must reformulate with high precision how were con- 
structed all the CR- wedges obtained by the propagation Proposition 3.14. 

For every point p G M, there exists a local CR-wedge Wp ' attached to a 
neighborhood of p in M which is described by means of a family of analytic discs 
Ap^t,s (C)' where t and s are parameters. Here, the subscript p is not a parameter, it 
indicates only that p is the base point of ^p,t,s, namely Ap t,o(l) = P- The family 
Ap^t,s enjoys properties that ai^e listed below. In this list, the conditions ai^e more 
uniform than those formulated in Definition 3.4, but one immediately verifies that 
both formulations are equivalent, up to a shrinking of ti{p) > 0, of si{p) > 0, of 
6*1 (p) >Oandof l-ri(p) > 0. 

• The rotation parameter t G M*^"^ runs in {\t\ < ti{p)}, for some small 
ti(j)) > 0. 

• The translation parameter s G ]^2m+d-i j.^^^ jj^ ^ si{p)}, for some 
small si{p) > 0. 

• The point q{p) := Ap^Qfi{—l) G M is close to p. 

• At q{p), there is a CR-wedge y^g(^f- 

• The family Ap^t,s satisfies Ap^tA^^) C il/ U ^g(^f- 

• A small angle 9i (p) > and a radius ri (p) > close to 1 ai^e chosen. 

• A family Hp/ of linear subspaces of Tp/C" satisfying Tp'Hp/ © Tp/M = 
Tp/C" for all p' G M in a neighborhood of p is chosen. 

• For every t with \t\ < ti{p), every s with \s\ < si{p) and every 9 with 
\9\ < 9i{p), the exit vector of Ap^t,s{e^^) at e*^ is not tangent to M: 

ex(A,,.)(.-):=proj„,^.„..„(.5^(«"))#0, 

• For every fixed s with |s| < si{p) and every fixed 9 with \9\ < 9i{p), the 
normalized exit vector mapping 

M^-i 9 t ^ n-ex(Ap,t,,)(e^^) G S^^^ 

is of rank (e — 1) at every t G < ti{p)}. 
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For some t2ip), S2{p), 6*2 (p) and r2{p) satisfying < t2{p) <ti{p),0 < 
S2{p) < si{p), < 92ip) < Oi{p) and < 1 - r2{p) < 1 - ri{p) < 1, 
the CR- wedge is precisely defined as: 



,CR,e _ ^^Ap,tAre'') ■■ \t\ < t2{p), \s\ < S2{p), \e\ < e2{p), r2{p) < r < l} . 

Finally, the CR-wedge Wp^''^ is contained in a C^'""'' local generic sub- 
manifold M.p of the same dimension 2m + d + e that contains a neigh- 
borhood of p in M. At a point p' = ^'(e*^') G M of the edge of 
Wp the tangent space of is: 



l<fc<e-l 



4.5. An edge-of-the-wedge theorem. There are as many generic submanifolds 
-A/i^^'*^ of codimension d — e as points p' S M. At a point p = j/ ,,'(e*^') that 

belongs to the edge of such an M.^, ' , we may define a linear subspace of T^M 
by 

KMp,{p) := T^Ml, n TpM. 

Since A^^, is generic and contains M in a neighborhood of p, this space KMpt {p) 
contains T^M and is {2m + e)-dimensional. Also, multiplication by i induces an 
isomorphism KMp>{p)/T^M ~ TpMp/TpM. 

In general, two different KMpi{jp) and KMpn{jp) need not coincide, or equiv- 
alently, two different tangent spaces TpA^^, and TpM^,, are unequal. 




More precisely, there is a dichotomy. 

(I) Either for every two points p' ,p" G M such that there exists a point p 



belonging to the intersection of the edges of the two CR-wedges W^, 



CR,e 
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and yy^,^'*^, namely of the form: 

P = ^p',t',^'(e*^') = ^p",t",^"(e*^"), 
for some values 

\t'\ < t2{p'), \s'\ < S2{p'), \e'\ < e2{p'), 

\t"\<t2{p"), \s"\<S2{p"), \6"\<d2{p"), 

the two spaces TpMp, and TpA^^,, coincide. Equivalently, KMpi (p) = 
KMp..{p). 

(II) Or there exist two points p' ,p" G M and a point p = Api t' .s'ie^^') = 
^p".t",s"(6*^") ill intersection of the edges of the two CR- wedges 
W'^,^'^ and W^,^'" such that 

TpMl, / TpMl„. 



Lemma 4.6. The case TpM^, / TpM^,, implies that C^^{M) extends to be 

CR on a CR-wedge W^^'^^^ at p whose dimension equals 2m + d + 1 + e, 
contradicting the maximality of e = Cmax- 

Of course, this lemma follows by a known CR version of the edge-of-the- wedge 
theorem ( ||Ail989l ). but for completeness, we summarize a shorter proof that ex- 
ploits the existence of the discs Api^t.s, as in IIPo2004l . 

Proof. By construction, the family Api^t,s{C,) covers the CR-wedge W^^'^. The 
point p belongs to the edge of W^, ' . 

Since TpM^, / TpM^,,, there exists a manifold C W^,^''' attached to M 
at p with dim = 1 + dim M such that 



1 + e = dim 



'TpM 




Translating A^i ^t.s along 
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We may deform the family Api^t,s by translating it along Mp, as in the diagram. 
So we introduce a supplementary pai^ameter a > and we require that the point 
Ap'^t,s,a{^) should cover a one-sided neighborhood of p in Mp as a runs in (0, ai), 
for some small ai > 0, and as the previous translation parameter s G jgSm+d-i 
runs in < S2{p')}- Thanks to Theorem 3.7(IV), the corresponding Bishop- 
type equation has solutions. 

If we choose > with \t'\ + fa < t2{p'), S3 > with \s'\ + S3 < S2{p'), 
6*3 > with \9'\ + 03 < 02{p'), 0-3 > with 0-3 < ai and r3 < 1 with r2{p ) < 
r3 < 1, the set: 

VFp^«'i+^ := {Ap,,t^sAre'') : \t - t'\ < ts, \s - s'\ < S3, 

\9 - 9'\ < 03, rs < r < 1, < a < a^} 

will constitute a CR-wedge of dimension 2m + d + 1 + e at p. By a technical 
adaptation of the approximation Theorem 5.2(111) {cf. Lemma 2.19), C^j^{M) 
extends to be CR on Wp^'^'^" . □ 

4.7. Definition of the (non-integrable) subbundle KM c TM. Consequently, 
case (II) cannot occur, because of the definition of e = Cmax- Thus, case (I) holds. 
In other words, as p' runs in M, the distributions p h-> KMpi{p) defined 

for p in the edge of Wp,^''^ (a neighborhood of p' in AI) glue together in a well- 
defined Ci'^-o vector subbundle of TM. Observe that T^Af is a subbundle of 
KM of codimension e. For every point p ^ M, we have: 

T^M C KM{p) = T^Ml n TpM. 

As in §4.1(j), since M is globally minimal and since KM is of codimension 
d - e ^ 1 in TM, there must exist a point p € M such that [KM, KM] (p) ^ 
KM{p). 

Lemma 4.8. At such a point p, the Levi form ofAip does not vanish identically: 

[T'Ml,T'M'p\ {p)^T^M;. 

Proof. We reason by contradiction, assuming that [T^Mp,T^Mp] (p) C TpMp. 
Let K^ and K^ be two arbitrary C^'""" sections of KM defined in a small neigh- 
borhood Up of p in M. Since KM\ij^ is a subbundle of TM\ij^, we have 

[K\K^] {p)eTpM. 

We may extend K^ and K"^ to a neighborhood Up of p in A4p that contains Up as 
sections /C^ and /C^ of T^Mp\up- Since K^ and K"^ are tangent to M n Up, one 
verifies that, independently of the extension: 

[K\K^] {p)=[}C\}C^]{p)eT^M;, 
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where the second Lie bracket belongs to T^J^^, because we assumed that the 
Levi form of J\Ap vanishes at p. We deduce 

[K^,K^] {p) G T^Ml n TpM = KM{p). 
This contradicts [KM, KM] (p) KM{p). □ 



4.9. Lewy extension on CR-wedges. To contradict the maximality of e = Cmax 
at a point p at which [KM, KM] [p) KM{p), we formulate a Lewy extension 
theorem on the conic manifold with edge Wp ' . 

Proposition 4.10. Let p e M and assume that [TpMp,TpMp] (p) <t TpMp. 
Then there exists a {2m + d + 1 + e)-dimensional local CR-wedge Wp^'^^'^ of 
edge M at p to which C^j^{M U W^^'^) extends to be CR. 

Thus, this proposition concludes the proof of Theorem 3.8. 

Proof. There exists a local section L of T^'^M.^ with L{p) ^ such that 
[L, L] {p) Tp'^A^p © Tp'^Mp. It is appropriate to distinguish two cases. 

Firstly, assume that L{p) G T^'^M. Then as in §4.2, we may construct a 
small analytic disc yl^ attached to M in a neighborhood of p having exit vector 
-^(1) approximately directed by [L,'L\ {p) C TpM^. So this disc has 
exit vector nontangential to Al^ at p. By translating it along M and along the e 

supplementary directions offered by Wp^''^ , we deduce CR extension to a (2m + 
d+l + e)-dimensional CR wedge 




Secondly, assume that L{p) T^'^M for every local section L of T^'^M such 
that [L,L\ {p) tI^'^MI © T°'^7W^. 

We explain the case d = 2, e = 1 first, since this case is easier to understand. 
Under this assumption, M.^ is a hypersurface of C" divided in two parts by M, 

C Ft 1 

one part being Wp ' . We draw a diagram. 
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Disc attached to a half hypersurface and having nontangent exit vector 



There exist coordinates {z,w' ,w" ) G C"~2 X C X C centered at p in which 
Mp is given by v" = ip{z, w' ,u"), with ^(0) = and dip{0) = and in which 
M is given by a supplementary equation v' = ip'{z,u' ,u") with (p'{0) = and 
d(p'{0) = 0. Changing the orientation of the u'-axis if necessary, it follows Wp '^'^ 
is given by the equation v" = Tp{z, w' ,u") and the inequation v' > (p'{z, u' , u"), 
with (p'{0) = and dip'{0) = 0. In the diagram, T^Mp is the direct sum of the 
z-coordinate space with the u' + i i;' -coordinate axis. 

The Levi form of Mp is represented by a scalar- Hermitian form 
H{z,w' ,z,w'). By assumption, its restriction to TpM vanishes (other- 
wise, the first case holds), so H{z, 0, z, 0) = 0. The assumption that the Levi 
form of J\A}p does not vanish identically insures that H is nonzero. To proceed 
further, we need i/(0, -w', 0, u;') ^ 0. If H{fd,w' ,Q,w') = 0, since H is 
nonzero, by a linear coordinate change of the form w' = w' , z^ = z^ + flfc w' , 
k = 1, . . . ,n — 2, w" = w", we may insure that H{0, w' , 0,w') ^ 0. Observe 
that such a change of coordinates stabilizes both TpM and TpAdp. After a real 
dilation, we can assume that the equation of Mp is of the form: 

v'' = w'w' + 0{\w'\'^+'^-^) + 0{\z\\{z,w')\) + 0{\u''\\{z,w')\) + 0{\u''\'^). 

To the hypersurface Mp, we attach a disc ^^(C) with zero z-component, with w'- 
component equal toie (l — C) and with u/' -component {U"{C) +i V"{C)) of class 
(j2,Q-o satisfying the corresponding Bishop-type equation. Exactly as in the Lewy 
extension theorem (§2.10), for e > small enough and fixed, the exit vector of 
at p is nontangent to Mp (this is uneasy to draw in the diagram above, but imagine 
that the disc drawn in §2.10 is attached to a half -paraboloid). Furthermore, using 
the inequality w'(e*^) =e(l — cos0) ^ e^for |0| ^ vr together with the property 
dip'{0) = 0, it is elementary to verify that Ai;{d A\{1}) is contained in the open 
half -hypersurface {v' > ip'}, as shown in the diagram. 

Since the exit vector of is nontangent to Mp, in order to get holomorphic ex- 
tension to a wedge at p, it suffices to translate the disc A^ in the half -hypersurface 
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However, if we translate as usual by requiring that the base point ^^^^(l) = 
Ps, with s G M^"~^ small, covers a neighborhood of p in M, it may well hap- 
pen that, due to the curvature of M in a neighborhood of p, the boundary of the 
translated disc enters slightly the other side of Mp, which is forbidden. 

To remedy this imperfection, two equally good options present themselves. 
The first option would be to rotate slightly the translated disc ^ in order that 
it becomes tangent to M at the point ps = .,(1). Then adding a small pa- 
rameter a > 0, we would translate it slightly in the positive direction of Wp ' , 
essentially along the positive u'-direction. 

The second option is to introduce a family of complex affine biholomorphisms 
^'s that transfer G M to the origin and transfer the tangent spaces at ps of 
Ml and of M to {v" = 0} and to {v" = v' = 0}. So *s(A4^) is given by 
v" = t/j" [z , w' , u" : s) with tjj of class C^'"^*^ with respect to all variables and 
with the map {z,w',u") i— > t/j" {z,w' ,u" : s) vanishing to second order at the 
origm for every s G M^"-^ small. Also, ^'.(W^^'^) is given by a supplementary 
inequation v' > ip'{z,u',u" : s), with 99' of class C^'" (the smoothness of M) 
with respect to all variables and with {z,u' ,u") 1— > ip{z,u',u" : s) vanishing to 
second order at the origin. 

To the hypersurface ^s(-A^p)> we attach the family of discs 

Ae,sAO = (0, i a + (1 - C), U'ls^C) + iV:i,AO) 

having zero z-component and lu' -component equal to ia + ie{l — (), where 
cr G M with |cr| < di, di > 0, is a small parameter of translation along the 
y'-axis. Of course: 

By means of elementary computations involving Taylor's formula, we verify two 
facts. 

• If e > is sufficiently small and fixed, ^ o(f^'^\{l}) is contained in 
the open half-hypersurface {v' > ip'{z,u',u" : s)}, for all s G M^"~^ 
with |s| < si, si > small. 

• Furthermore, for all a with < a ^ ai, and all s with |s| < si, the disc 
boundary ^(SA) is contained in the open half-hypersurface {v' > 

(p'{z, u' , u" : s)}. 

Coming back to the old system of coordinates, it follows that the family of discs 
^£,s,<7 '•= ° h^s base point A^^s,<7{^) covering a neighborhood of p in 

CR 1 

the half-hypersurface Wp ' , as s and a vary. Since the exit vector of A^ is not 
tangent to Ai^, at p, this family of discs covers a 277,-dimensional wedge Wp^''^"' 
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of edge M at p. This completes the proof of the second case of the proposition 
when e = 1 and d = 2. 

Based on these explanations, we may now summarize the general case. There 
exist coordinates {z,w' ,w") G C^xC^xC^"*^ vanishing at pin which the C^'""*^ 
generic submanifold A^^ is represented by v" = ip{z, w' , u"), with ^^J{0) = and 
dip{0) = 0. After killing the second order pluriharmonic quadratic terms in every 
right hand side ipj" {z, w' , 0), /' = 1, . . . ,d — e, we may assume that the quadratic 
terms are Hermitian forms Hjn {z, w' , z, €)'). 

After a linear change of coordinates in the w' -space, TpM = {v' = v" = 0}, 
the C^'" generic edge M is defined by v = ip{z, u) with 99(0) = 0, dip{0) = 
and the conic open submanifold Wp^''^ of ^Ap is defined by v" = 'ip{z, w' ,u") 
together with the inequations 



where ip = {if' , 99"). In fact, we may assume that the cone defining the CR-wedge 
on the tangent space is slightly larger than the salient cone v'j, > 0, j' = 1 , . . . , e. 

The nonvanishing of the Levi form of at p entails that at least one Her- 
mitian form Hj"{z,w' ,z,w') is nonzero. After renumbering, Hi is nonzero. 
Also, since T^M is the z-coordinate space, we have Hi{z,0, z,0) = (oth- 
erwise, the first case holds). After a complex linear coordinate change of the 
form w' = w', Zk = z^ + Yl'j'=i '^i "^'j'^ — ^ insure that 

Hi{0,w' ,0,w') ^ 0. Then the set of vectors {0,w') on which Hi vanishes is 
a proper real quadratic cone of C^. Consequently, for almost every real vector 
{0,iv'), the quadratic form Hi is nonzero on the complex line C{0,iv'). Since 
the cone defining Wp ' is open and may be slightly shrunk, we can assume that 
Hi does not vanish on C{0,iv[), with v'l = (1, . . . , 1) £ R". It follows that 
the disc attached to Mp having zero z-component and t/;' -component equal to 
(i e (1 — C), . . . , i e (1 — 0) is nontangent to A4p at p. 

Furthermore, letting a point ps G M of coordinates s := {z,u) vary in a 
small neighborhood of p in M, we may construct a family of biholomorphisms 
sending ps to the origin and normalizing the equations of M, of A4p and of Wp ' 
under the form v = (p{z, u : s), v" = il>{z, w' ,u" : s) and v'j, > ip'j,{z, u', u" : s), 
with (p being C^'" and with tp being C^''^-^ with respect to all variables and both 
vanishing to second order at the origin. 

Let a G M^, \a\ < ci, be a small parameter of translation along the v'- 
coordinate space. To the generic submanifold "^si-Mp), we attach the family of 



Vj, > (p'j,{z, u', u") 



j' = l,...,e 



discs 



A,,sAO = (0, w^AO, u'l^AO + i v^[,AO) 



where 



W',AC) = [iai+ie{l-C) 



,. . . ,icre + ie(l - C)) 
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and where 

-Ti [^(0, ia + ie{l--), U'l,^,{-) : s)] (e*^), 

By means of elementary computations involving Taylor's formula, we may verify 
that for all a £ W with < cjj, ai, j' = 1, . . . , e, and all s £ M^m+d^ 
|s| < si, the disc boundary As,s,a{dA) is contained in {v'j, > ip'j,{z,u' ,u" : 
s), f = 1, . . . ,e}. 

Coming back to the old system of coordinates, it follows that the family of 
discs Ai;^s,cT '•= ° Ae,s,cT has base point ^(1) covering a neighborhood of 

C Ft e 

p in the CR-wedge Wp ' , as s and a vary. Since its exit vector is not tangent to 
Mp at p, this family of discs covers a (2m + d + 1 + e) -dimensional CR-wedge 

Wp^^'^+'ofedgeMatp. 

The proofs of the proposition and of Theorem 3.8 are complete. □ 

4.11. Wedgelike domains. On a globally minimal M, at every point p G M, we 
have constructed a local wedge Wp by gluing deformations of discs. It may well 
happen that at a point p that belongs to the edges of two different wedges Wq' and 
Wq" , the wedges have empty intersection in C" (imagine two thin opposite cones 
having vertex at G M?). Fortunately, by means of the translation trick presented 
in §4.5 (cf. the diagram), we can fill in the space in between. Achieving this 
systematically, by a sort of gluing-shrinking processus, we obtain some connected 
open set W attached to M containing possibly smaller wedges Wp C Wp at every 
point. 

To set-up a useful definition, by a wedgelike domain W attached to M we 
mean a connected open set that contains a local wedge of edge M at every point. 
Geometrically speaking, the requirement of connectedness prevents jumps of the 
directions of local wedges in the normal bundle TC"|jv//TM. 

We may finally conclude this section by the formulation of a statement that is 
the very starting point of the study of removable singularities for CR functions 
( IIMP1998[lMP1999[lMP2000llMP2002[|MP2006all ). 

Theorem 4.12. ( IIMel9971 IMP1999II ') // M is a globally minimal C^'" generic 
submanifold of C", there exists a wedgelike domain W attached to M such that 
every continuous CR function f G C^^(M) possesses a holomorphic extension 
F G 0{W) n C^{M U W) with F\m = f. 

Its LP version deserves special attention. Let W be a wedgelike domain at- 
tached to M. A holomorphic function F G 0(W) is said to belong to the Hardy 
space H^^jyV) if, for every p G M, for every local coordinate system centered at 
p in which M is given by v = ^p{x, y, u), for every local wedge of edge M at p 
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contained in W of the form 

W = Wip,a,C) := {{x + iy,u + iv) G A™ x x iD^ : 

V - ^{x,y,u) e C}, 

as defined in §4.29(111), for every cone C C with C n S'^^^ CC C n 5'^^^ 
and for every p' < p, the supremum: 

sup / \F (^x + iy,u + i(p{x,y,u) + i9')\^ dx A dy A du < oo 

p p 

is finite. An adaptation of the proof of the preceding theorem yields its version. 

Theorem 4.13. ( l|Pol997[Fo2000ll ) IfM is a globally minimal C"^'" generic sub- 
manifold ofC^, there exists a wedgelike domain W attached to M such that every 
function f £ L'^^^ 1 ^ p ^ oo, possesses a Hardy space holomorphic exten- 
sion F G Hl^m. 

To conclude, we would like to mention that arguments similar to those of The- 
orem 4. 12 yield a mild generalization, worth to be mentioned: the CR extension 
theory is valid for C^'" CR manifolds that are only locally embeddable. 

However, for concreteness reasons, we preferred to set up the theory in a glob- 
ally embedded context. In the remainder of the memoir, not to enter superficial 
corollaries, we will formulate all our results under the paradigmatic assumption of 
global minimality. Thus, Theorems 4.12 and 4.13 will be our basic main starting 
point. 

The two monographs MTrv 1 992 [ IBCH20051 deal not only with embedded struc- 
tures but also with locally integrable structures. Nevertheless, most topics exposed 
here are not yet embraced in a comprehensive theory {cf. §3.29(111)). So it is an 
open direction of research to transfer the theory of holomorphic extension of CR 
functions (including removable singularities) to locally integrable structures. 
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[7 diagrams] 



Removable singularities for general linear partial differential operators P = 
S/^eN™ o.p{x)dx on domains i7 C M" having order m ^ 1 and C°° coeffi- 
cients have been studied by Harvey and PoMng (1970) in a general setting. As- 
sumptions of metrical thinness of singularities, in the sense of Minkowski content 
or of Hausdorff measure, insure automatic removability. For instance, relatively 
closed sets C d Q. whose (n — m) -dimensional Hausdorff measure is null ai^e 
(P, L^^)-removable. For structural reasons, these general results (valid whatever 
the structure of the operator) necessitate a control of growth when dealing with 
L^^^^ -removability. In addition, when P is an embedded complex-tangential op- 
erator, this approach does not convey to the adequate results, because removable 
singularities for holomorphic or CR functions must take advantage of automatic 
extension to larger sets. 

Since almost two decades, thanks to the impulse of Stout, removable singulari- 
ties have attracted much attention in several complex variables. A natural question 
is whether the Hartogs-Bochner extension Theorem 1.9(V) holds when consider- 
ing CR functions that are defined only in the complement dfl\K of some compact 
set K C dQ of a connected smooth boundary 5^7 C C". In complex dimension 
n = 2, Stout showed that the answer is positive if and only if K is convex with 
respect to the space of functions that aie holomorphic in a neighborhood of Q.. In 
complex dimension n ^ 3, a complete cohomological chai-acterization of differ- 
ent nature was obtained by Lupacciolu (1994). 

In another direction, by means of the above-cited global continuity principle, 
Joricke (1995) generalized Stout's theorem to weakly pseudoconvex domains. Re- 
cently, Joricke and the second author were able to remove the pseudoconvexity as- 
sumption by applying purely geometrical constructions without integral formulas, 
controlling uniqueness of the extension (monodromy) by fine arguments. 

Within the general framework of CR extension theory (exposed in Part V), the 
study of removable singularities has been endeavoured by Joricke in the hypersur- 
face case since 1988, and after by the two authors in arbitrary codimension since 
1995. The notions of CR-, W- and LP-removability, although different, may be 
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shown to be essentially equivalent, thanks to technical deformation arguments. 
All the surveyed results hold in Lj'^^ with 1 ^ p ^ oo, including p = 1 and 
without any growth assumption near the singularity. On a generic globally min- 
imal C^'" generic submanifold M of C", closed sets C C M having vanishing 
(dimM — 2) -dimensional Hausdorff measure ai^e CR-, W- and L^-removable. 
As an application, CR meromorphic functions defined on an everywhere locally 
minimal M do extend meromorphically to a wedgelike domain attached to M. 

In conjunction with the Haivey-Lawson complex Plateau theorem, singulari- 
ties C that are a priori contained in a 2-codimensional C^'" submanifold of a 
strongly pseudoconvex C^'" boundary dO. C (n ^ 3) are shown by Joricke to 
be not removable if and only if N is a maximally complex cycle. The condition 
that N be somewhere generic was shown by the two authors to be sufficient for 
its removability in arbitrary codimension. 

Concerning more massive singularities, a compact subset AT of a one- 
codimensional submanifold C SJl C C" is CR-, W- and LP-removable 
provided the CR dimension of 50 is ^ 2 (viz. n ^ 3) and provided K does 
not contain any CR orbit of (Joricke, 1999). The second author generalized 
this theorem to higher codimension, assuming that M is globally minimal of 
CR dimension m ^ 2. The main geometric argument (called sweeping out by 
wedges) being available only in CR dimension m ^ 2, the more delicate case of 
CR dimension m = 1 is studied extensively in the research article IIMP2006all . 
placed in direct continuation to this survey. 



§1. Removable singularities for 
linear partial differential operators 

1.1. Hausdorff measure. Let M be a abstract manifold of dimension n ^ 1 
equipped with some Riemannian metric. For ^ G M with ^ ^ ^ n, we remind 
( IIChl989ll ) the definition of the notion of ^-dimensional Hausdorff measure on 
M, that generalizes the notion of integer dimension of submanifolds. 
If C C M is an arbitrary subset and if 5 > is small, we define 

r ^ 1 

^5 (C) = inf < r| : C is covered by geodesic balls Bj of radius ^ (5 > . 

(j=i J 

Clearly, H|(C) ^ H^,(C), for 5' ^ 5, so the limit H^(C7) = lim H^(C) exists in 

5 — 

[0, oo]. This limit is called the £ -dimensional Hausdorff measure of C. The value 
of H^(C) depends on the choice of a metric, but the two properties H^(C) = 
and H^(C) = co are independent. The most significant property is that there 
exists a critical exponent ic ^ 0, called the Hausdorff dimension of C, such that 
H^(C) = oo for all i < ic and such that H^(C) = for all £ > ic- Then the 
value H^c'(C) may be arbitrary in [0, cxd]. 
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Proposition 1.2. ( IIFel969[|Chl989ll ) The following properties hold true: 

(1) H0(C) = Card(C); 

(2) H"(C) coincides with the outer Lebesgue measure ofCc M; 

(3) a submanifold N C M has Hausdorff dimension £n = dim A^; 

(4) //■H"~^(C) = 0, then M\C is locally connected; 

(5) if f : M ^ N is a map and ifC C M satisfies H^(C) = 0/or some 
I ^ dimiV, then for almost every q £ N, it holds that H^"'i™'^(C n 

(6) H^(C) = if and only ifH^{K) = Ofor each compact set K C C. 

1.3. Metrically thin singularities of linear partial differential operators. Let 

be a domain in M" , where n ^ 1. We shall denote the Lebesgue measure by 
H". Consider a class of !F{^) of distributions defined on Jl, for instance ^{^^($7), 
^"'"(17) (k G N, ^ a ^ 1) or ^^{VL). Consider a linear partial differential 
operator 

of order m ^ 1, defined in $7 and having C°° coefficients a/3(x). 

Definition 1.4. A relatively closed subset C of $7 is called {P, J^) -removable if 
every / G ^{^) satisfying Pf = in il\C does satisfy Pf = in all of il, in 
the sense of distributions. 

For instance, according to the classical Riemann removability theorem, discrete 
subsets {pk}keN of a domain QinC are {d, L°°) -removable. In fact, since every 
distribution solution of d is holomorphic (hypoellipticity), functions extend to be 
true holomorphic functions in a neighborhood of each p^. The Riemann remov- 
ability theorem also holds under the weaker assumption that / G 0{Q\{pk}k£N) 
satisfies f{z — pk) = o{\z — Pk\~^) as z approaches p^. 

In several complex variables, the classical Riemann removability theorem may 
be stated as follows. 

Theorem 1.5. ( ||Chl989l ) Let Ti be a complex analytic subset ofQ. Holomorphic 
functions in r2\S extend uniquely through S either if dime S ^ n — 2 or if 
dime S = n — 1 and they belong to L'^^{Q). 

The second case also holds true for functions that belong to Lf^JQ). The 
proofs are elementary and short: in one or several complex variables, everything 
comes down to observing that Ms a true 0(|i|) near z = and does not belong 

to iL- 

These preliminary statements are superseded by more general removability the- 
orems, exposed in HHP 197011 . that we shall now restitute. Some of the (elemen- 
tary) proofs will be surveyed to give the flavour of the arguments. 
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In 1956, S. Bochner ( IIBol9561lHP1970ll ) established remarkable removability 
theorems, valid for general linear differential operators P, in which the metrical 
conditions on the size of the singularity C depend only on the order m of P. Some 
preliminary material is needed. 

Lemma 1.6. Let K C M" be a compact set. For every e > 0, there exists a 
function (p^ G C^(M") with ip^ = l in a neighborhood of K and with supp99£ C 
Ke such that \d^^pe{x)\ ^ £-\^\ for all x G M" and all {3 G N". 

Proof. Denote by Ib(-) the characteristic function of a set S C M". It suffices 

to define the (rescaled) convolution integral ip£{x) := l^^^^ly) i'ii^ ~ 

y)/e) dy, where -0 G C^(M") has support contained in ^ 1/3} and satisfies 

)^{y)dy = l. □ 

It may happen that C is not (P, ^)-removable, whereas C is removable for 
some individual function / G ^{^) satisfying certain supplementary conditions. 
In this case, we shall say that C is an illusory singularity of /. 

Theorem 1.7. ( IIBol956[ IHP1970II ) Let f G Lj^^{n). If for each compact set 
K C C, we have 

liminf [e— ||/ = 0, 

then C is an illusory singularity of f. 

Whenever the integral is meaningful, for instance if / G Lj^^{Q) and (p G 
C^(J7), we define (/, ip) := f cp, where the integral is computed with respect 
to the Lebesgue measure. The formal adjoint of P, denoted by *P, satisfies the 
relations {Pp, ip) = [p, ^Ptp) for all p, tf; ^ C^{^), and these relations define it 
uniquely as 

\(3\<im 

Proof of Theorem L7. Let K := (suppers) Pi C and let p^ be the family of func- 
tions constructed in Lemma 1.6. Since suppP/ C C, we have {Pf,p) = 
iPf,PeV) = {f,'P{peP)). Lemma 1.6 entails that \\'P{pep)\\^^ ^ Ce"'", 
for some quantity C > that is independent of e. We deduce that | (P/, p) \ ^ 
C e""* 1/ 1^1 for all e > 0. Thanks to the main assumption, this implies that 
(P/,^)=0. □ 

If p G M with 1 ^ p ^ oo is the exponent of an L^-space, we denote by p' := 
G [1, oo] the conjugate exponent, also defined by the relation 1 = -i + ^. By 

Holder's inequality, we have W/IkAl^ ^ (H"(K,))'/p' UIrAlp- 

Corollary 1.8. Let f G Lf^^{^), where 1 ^ p ^ cxo. If for each compact set 
K C C, 

liminf r^c-^P'un^T^ ^^l/p' 



p'h"(k,))'/p' \\flK^ 



LP 
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then C is an illusory singularity of f. 

The next theorem translates Corollary 1.9 in terms of Hausdorff measures, a 
finer concept than the Minkowski content. 

Theorem 1.9. ( IIHP1970II ) (i) Le? 1 < p < oo and assume that n - mp' ^ 0. If 
l_|n-mp f^jt^-j ^ oo for every compact set K C C, then C is {P, L'^^^)-re}novable. 

(ii) Let p = oo and assume that n — m ^ 0. If H"~'"(C) = 0, then C is 
(P, Lf^J-removable. 

(iii) Let p = oo and assume that n — m ^ 0. If H"~™(i^) < oo for each 
compact set K C C, then Pf is a measure supported on C, for every f £ 
satisfying Pf = on il.\C. 

An application of (ii) to P = 9 in one or several complex variables yields the 
Riemann removability Theorem 2.31 below. 

Proof. We survey only the proof of (i). Let ip G (17) and set := CPlsupp 99. 

Lemma 1.10. ( IIHP1970II ) Let K C M" be a compact set. Let p' with 1 ^ p' < 00 
and assume n — mp' ^ 0. For every e > 0, there exists ipe G C^(M"') with 
(f^ = 1 in a neighborhood of K and with supp C Kf, such that for all [3 E N" 
with \ f5\ ^ m, we have 

\\d^^e\\LP' ^ Ce"^-l^l(H"-'"P'(i^) 

where C > is independent of e. 

With such cut-off functions y?^, since suppP/ C C, we have {Pf,ip) = 
{Pf, (pe if) = (/, *P(<^e ^)). By Holder's inequality and the preceding lemma: 

\{Pf,^)\ ^ WJIkAl^ ir^(^.^)|Lp' ^ C ll/l^Jl^p (H'^— P'(i^) + e)^/P'. 
The theorem follows from 

lim ||/lj^J|^p=0, 

since H"iKe) (remind H^-'^p' (K) < 00). □ 

It seems impossible to get removability without an assumption of growth. 
At the opposite, in a CR context, the techniques introduced in IIJo 1 999bl IMP 1 999 1 
that are developed in Section 5 and in ||MP2006a|| will exhibit -removability 
of certain closed subsets of generic submanifolds with only metrico-geometric 
assumptions. 



210 



JOEL MERKER AND EGMONT PORTEN 



2. Removable singularities for holomorphic functions of one 



2.1. Painleve problem, zero length and analytic capacity. The classical 
Painleve problem ( IIPal888[ IAhl947ll ) is to find metric or geometric characteri- 
zations of compact sets K C C that are {d, -removable, i.e. such that every 
/ G 0{C\K) n L°°(C\J^) extends holomorphically through K. 

Theorem 1.9(ii) says that H^(A') = suffices. It is also known ( ||Mal984[ 
IPa2005ll ) that if H^+^(A') > for some e > 0, then K has positive ana- 
lytic capacity (definition below) and is never {d, L°°) -removable. Furthermore, 
Garnett ( ||Garl970|| ) constructed a self-similar Cantor compact set i^T C C with 
< H^(A') < +00 which is (9, L°°)-removable. Consequently, Hausdorff mea- 
sure is not fine enough. 

Under a geometric tameness assumption a converse to the sufficiency of 
H^{K) = holds and is usually called the solution to Denjoy's conjecture. 

Theorem 2.2. ( ||Call977[ ICMM1982D A compact set K C C that is a priori 
contained in a Lipschitz curve is (d, L^) -removable if and only if it has zero 
1-dimensional Hausdorff measure. 

Classically, this statement is an application of the celebrated result of Calderon, 
Coifman, Mcintosh and Meyer about the L^-boundedness of the Cauchy integral 
on Lipschitz curves. Let us survey one of the simplified proofs ( IIMV1995I ) which 
involves Menger curvature, a concept useful in a recent answer to Painleve's prob- 
lem obtained in IITo2003l . 

Let r := G : y = ^{x)} be a (global) Lipschitz graph; here 

if G C^'^ is locally absolutely continuous and ip' exists almost everywhere (a.e.) 
with ||(/7'||loo < +00. 

Theorem 2.3. ( IICall977llCMM1982llMVT995l ) If f £ L^{T), the Cauchy prin- 
cipal value integral 



exists for almost every z G F and defines a function C'^/(z) on F, the Cauchy 
transform of f, which belongs to A^(F) and satisfies in addition 



Parametrizing F by ^(t) = t + i y^{t), dropping the innocuous factor 1 + i ip'{t) 
and setting z := x -\- i^p{x), one has to estimate the L^-norm of the truncated 
integral 



OR SEVERAL COMPLEX VARIABLES 
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with a constant independent of e. Even more, interpolation arguments reduce the 
task to a single estimate of the form 



/ |C',(x/)|'^Ci|/|, 



where Ci = Ci (||v3'||loo) and where xi is the characteristic function of an interval 
/ C M of length |/|. Following MMV 19951 . a symmetrization of the (implicitely 
triple) integral ^(x/) Q(x/) provides 




• dxidx2dx3 + 0(|/|), 

where Se := {{x,y,t) £ : \y — x\ > e, |t — x| > e, \t — y\ > e} and where 
©3 is the permutation group of {1, 2, 3}. 

Then a "magic" ( IIPo2005i ) formula enters the scene: 

4:S{zi,Z2,Z3,) ^ ^ 



Zi - Z2\ \zi - Z^\ \Z2 - Z^\) C(2;.(2)) " ((a^^Cl)) C(^a{3)) " ((^^.(l))' 

where S{^z\^Z2^zz) denotes the enclosed area; the left hand side measures the 
"flatness" of the triangle. This crucial formula enables one to link rectifi ability 
properties to the Cauchy kernel. 

Definition 2.4. The Menger curvature of the triple {zi, Z2, z^} is the square root 
of the above 

/ N 4:S{zi,Z2,z:i) 
c{zi,Z2,Z3) := -; 

\Z1 - Z2\ \zi - Z3\ \Z2 - Zz\ 

one sets c := if the points are aligned. One also verifies that c{zi, Z2^ z^) = 
1/ R{zi, Z2, -^s), where R is the radius of the circumbscribed circle. 



Thanks to the nice formula and to the basic inequality 

c(C(x),C(y),C(i)) ^2 



ip{y)-Lp{x) _ ip(t)~ip(x) 
y—x t—x 



\t-y\ 



the previous symmetric Cauchy triple integral is transformed to an integral involv- 
ing geometric Lipschitz properties of P. After some computations ( IIMV1995II ). 
one gets/, |c;(x/)|' ^ Ci(||(/p'||loo) • |/|. 

Menger curvature also appeai^s in a recent result, considered to be an answer to 
Painleve's problem. 

Theorem 2.5. ( IITo2003[ IPa2005ll ) A compact set K d C is not removable for 
0{£\K)r\L°° {C\K) if and only if there exists a nonzero positive Radon measure 
p, with supp 11 C K such that 
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• there exists Ci > with ;u(A(2;, p)) ^ Ci pfor every ^ G C and p > 0; 

* II I [c{x,y,z)Y dp{x)dp{y)dp{z) < +oo. 

The first condition concerns the size of K; the second one is of quantitative- 
geometric nature. 

We conclude by mentioning a classical functional characterization due to 
Ahlfors, usually considered to be only a reformulation of Painleve's problem, 
but which has already found generalizations in locally integrable structures (§2.16 
below). The analytic capacity of a compact set C C io 

an-cap(i^) := sup{|/'(oo)| : / G H^iC\K), \\fU^ ^ l}, 

where H°°{C\K) denotes the space of bounded holomorphic functions defined 
in C\K (or defined in the complement of K in the Riemann sphere C U {oo}, 
because {oo} is removable). 

Theorem 2.6. ( IIAhl947[Pal984[|HTT997l ) A compact set K C C is removable 
for 0{C\K) n L°°(C\K) if and only ifan-cap{K) = 0. 

2.7. Rado-type theorems. A classical theorem due to Rado ( l|Ral924[ IS tu 19681 
|RS1989[|Chl994|| ) asserts that a continuous function / defined in a domain C C 
that is holomorphic outside its zero-set /^^(O) is in fact holomorphic everywhere. 
By a separate holomorphicity argument, this statement extends directly to several 
complex variables. In IIStul993i . it is shown that /~^(0) may be replaced by 
f^^{E), where C C is compact and has null analytic capacity. In MRS 198911 . 
it is shown that a continuous function defined in a strongly pseudoconvex hy- 
persurface M C (n 2) that is CR outside its zero-set is CR everywhere; 
a thin subset of weakly pseudoconvex points is allowed, but the case of general 
hypersurfaces is not covered. In IIA11993II . it is shown that closed sets f~^{E) 
are removable in the same situation, wehere C C is a closed polar set, viz. 
E C {u = — oo} for some subharmonic function u ^ — oo. Chirka strength- 
ens these results in the following theorem, where no assumption is made on the 
geometry of the hypersurface. 

Remind ( IIChl989[ Del 9971 ) that C C" is called complete plunpolar if 
E = {if = — oo} for some plurisubharmonic function if ^ — oo on C'". 

Theorem 2.8. ( IIChl994ll ) Let M C C" (n ^ 2) be hypersurface that is a local 
Lipschitz (C'^) graph at every point, let C be a closed subset of M and let f : 
M\C C"^\E be a continuous mapping satisfying ||/||cO(M\c) < ^ such that 
the set of limit values of f from M\C up to C is contained in a closed complete 

^'lf||/||L- s$ 1, setting := [/(oo)-/(z)] / [I-JM /(z)] , we have g((X3) = 0, 
||g||L- < land |5'(oo)| = |/'(oo)|/(l - |/(oo)|2) > |/'(oo)|, so that inthe definition of 
analytic capacity, we may restrict to take the supremum over functions g G H^{C\K) 
with ||(7||l°° ^ 1 and g{oo) = 0. 
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pluripolar set E C C" (m ^ 1). Then the trivial extension f of f to C defined 
by f := on C is a CR mapping of class on the whole of M. 

In higher codimension, nothing is known. 

Open question 2.9. Let M C (n 2>) be a generic submanifold of codimen- 
sion 2 and ofCR dimension m ^ 1 that is at least C^. Let f G C^{M) that is 
CR outside its zero-set /~^(0). Is f CR everywhere ? 

Remind that condition (P) (Definition 3.5(111)) for a linear partial differential 
operator P of principal type assures local solvability of the equations Pf = g. 
Remind also that nowhere vanishing vector fields are of principal type. 

Theorem 2.10. ( HHT 199311 ) Let C (n ^ 2) be a domain and let L be a 
nowhere vanishing vector field on having complex-valued coefficients and 
satisfying condition (P) of Nirenberg-Treves. If f £ C^{Q) satisfies Lf = in 
ri\/~^(0) in the sense of distributions, then f is a weak solution of Lf = all 
over i}. 

2.11. Capacity and partial differential operators having constant coefficients. 

The preceding results admit partial generalizations to vector field systems. Let 
Q, C M" be an open set and let P = P{dx) = X^/3gpjn a/3 dx be a linear partial 
differential operator having constant coefficients ap G C. By a theorem due to 
Malgrange, Ehrenpreis and Palamodov ( IIHol963i ). such a P always admits a 
fundamental solution, namely there exists a distribution E G V'{MJ^) such that 
P{dx)E = Sq is the Dirac measure at the origin. 

Let !F C P'(r2) be a Banach space, e.g. T = LP(0) with 1 $C p $C oo, or 
T = n C^ln), or = C°'°(0) with < a ^ 1. 

Definition 2.12. For each relatively closed set C C Q, the J^-capacity of C with 
respect to P is 

T-capp{C,dn) :=sup{|(P/,ln)| : feT, \\fh^l, supp (P/) d c}. 

If a closed setCcfl is {P, .7^)-removable, by definition Pf = everywhere, 
hence T-Cap p{C, = 0. The following theorem establishes the converse for 
a wide class of differential operators having constant coefficients. For (3 G N", 
denote by Q^^) (x) := dx Q{x) the /3-th partial derivative of a polynomial Q{x) G 
R[x]. 

Theorem 2.13. ( IIHP1972II ) Assume that P possesses a fundamental solution E G 
P'(M") such that P'-^\dx)E is a regular Borel measure on for every /5 G N"^. 
Let Q. <S: M" be a bounded domain and let C C Vtbe a relatively closed subset. 
Then 

• C is {P, Lf^ J -removable, 1 < p ^ oo, if and only if LP-capp{C, = 0; 

• C is {P, L°°C'^)-removable if and only if L'^C^ -cap p{C, n) = 0; 
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• Cis {P,C^'")-removable, < a ^ 1, if and only ifC°'°'-capp{C,n) = 
0. 

This hypothesis about P is satisfied by elliptic, semi-elliptic, and parabolic 
operators and also by the wave operator in ( IIHP1972II ). The theorem (whose 
proof is rather short) also holds true if P = P{x, dx) has real analytic coefficients 
and admits a fundamental solution E such that P^/^^E is a regular Borel measure 
for every f3 € N". But it is void in L^. 

Theorem 2.14. ( IIHP1972II ) There is a unique function, called a capacitary ex- 
tremal, /^^P G LP{n) with ||/"P||lp ^ 1 and Pf^^^ = in 9\K such that 
(P/"P,lf,) =LP-capp(A',f^). 

We observe that the definition of LP-capp(A', 17) is inspired from Ahlfors' 
notion of analytic capacity and we mention that the capacitary extremal /"^^p is 
linked to the Riemann uniformization theorem. 

Example 2.15. In fact, with Vt = C and P = d / dz =: d, the -capacity of a 
compact set C C with respect to d may be shown to be equal, up to the constant 
vr, to the analytic capacity of K, namely 

L°°-cap^(K,C) =7ran-cap(A:). 

Indeed, letting / G L°°(C), assuming that df is supported by K, choosing a 
big open disc D (s C containing K, integrating by parts (Riemann-Green) and 
performing the change of variables w := we may compute 

(8f. ic) = (Bf. i„) = 1 //^ I A = 1 m = . /'(oo). 

Remind (footnote) that in the definition of an-cap(A') given in §2.1, one may 
assume that /(oo) = 0. If in addition the complement of K in the Riemann 
sphere C U {oo} is simply connected, the unique solution /"^^p of (9/"p, Ic) = 
L°°-capg(A', C) asserted by Theorem 2.14, viz. the unique solution of the ex- 
tremal problem 

sup {|/'(oo)| : / G L°°(C), df/dz = in C\K, /(cx)) = and WfU^ ^ l} 

is the (unique) Riemann uniformization map /"^^p : (CU{oo})\A'^A satisfy- 
ing r"P(oo) = and 9^/"p(oo) > 0. 

2.16. Removable singularities of locally solvable vector fields. Let 

cS(M") := (/ G C°^(M") : lim = 0, Va, /? G N"| 

be the space of functions defined in and having tempered growth. As is 
known ( IIHol963ll ). the Fourier transform 

F/(C):= / e-2-<-'5>/(^)rf^^ /g5(M"), 
J MP 
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(x, := X]fc=i £,k, is an automorphism of 5(M") having as inverse 
F-V(0:= / e2-*<-'?)/(x)dx = F/(-0. 

Equipping 5(M") with the countable family of semi-norms Pa^pif) '■= 
sup^.gig,i \x'^dxf{x)\, the space 5'(M"') of tempered distributions consists of 
linear functional T on 5(M") that are continuous, viz. there exists C > and 
a, /3 G N" such that |(T, /)| ^ Cpo,,/3{f) for every / G 5(M"). 

For p G M with 1 ^ p ^ oo and for a G M, we remind the definition of the 
Sobolev space 

LP(M-) := {t G S'iR^ ■■ imiiP := ||A-'^T||^^ < oo}, 

where A""^ J{x) := F^^ [(1 + F T(^)] (x). For o" = k G N and p in the 

range 1 < p < co, the space Lk(M") is exactly the subspace of functions u G 
LP(M'^) whose partial derivatives of order ^ k (in the distributional sense) belong 
to LP(M"). This space is equivalently normedby \\u\\^p_ := J2\i3\<k II^^^ILp- 

Let C M" be a domain and let P = P{x,dx) = J2\i3\<m (^p{^)(^x be a 
linear partial differential operator of order m ^ 1 defined in Cl and having C°° 
coefficients a/3(x). 

Definition 2.17. We say that P is locally solvable in with one loss of derivative 
if every point p G has an open neighborhood Up C Q such that for every 
compactly supported T G La (Up), the equation PS = T has a solution S G 

Theorem 2.18. ( l|BeFel973[|HP1996l ) Let Lbe a nowhere vanishing vector field 
having C°° coefficients in a domain Q, C M" (n ^ 2) and assume that L satisfies 
condition (P) of Nirenberg-Treves. Then for every p G M with 1 < p < oo, the 
operator L is locally solvable in LP with loss of one derivative. 

Example 2.19. As discovered in MHT 19961 . local solvability fails to hold in L°° 
for the (locally solvable) vector field — ^ g"^/'^' ^ satisfying (P) on M^. 

Removable singularities for vector fields in LP have been studied in MHT 1 996 [ 
IHT1997I . Because of the example, results in LP with 1 < p < cxd differ from 
results in L°° . 

Definition 2.20. A relatively closed set C C i7 of an open set Q. C M" is 
everywhere {P, L'^) -removable if for every open subset U d Q. and for every 
/ G LP(C/) satisfying P/ = in U\C, then / also satisfies P/ = in all of U. 

Theorem 2.21. ( IIHT19961IHT1997I ) Let L be a nowhere vanishing vector field 
having C°° coefficients in an open subset Q C M" {n ^ 2) and assume that L 
satisfies condition (P). Let p G M with 1 < p < co. Then a relatively closed set 
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C C is everywhere {L, L^)-removable if and only if there is an open covering 
of C by open sets Qj, j G J, such that 

LP-capi(Cn%,Oj) = 0, 

for every j G J. 

In when trying to perform the proof of this theorem, local solvability of 
positive multiples of L is technically needed. Observing that Pf = is equiva- 
lent to e^Pf = 0, the following notion appeared to be appropriate to deal with 
(L, L°°) -removability. 

Definition 2.22. ( IIHT1996IIHT1997II ) The Ml L°° -capacity of a relatively closed 
set C C with respect to L is 

full-L°°-caPi(C,l^) :=sup |L°°-cap2(C7,f))|, 

where the supremum is taken over all vector fields L = e'^ L with ip G C°°(0) 
satisfying sup^j ^ 1 for W\ ^ 1- 

By a fine analysis of the degeneracies of L and of the structure of the Suss- 
mann orbits of {ReL, ImL}, Hounie-Tavares were able to substantially gener- 
alize Ahlfors' characterization. 

Theorem 2.23. ( HHT 1 996 [IHT 199711 ') A relatively closed set C C ^ is everywhere 
(L, L°°) -removable if and only if there is an open covering ofC by open sets Vtj, 
j G J, such that 

full-L°^-capi(C n %) = 0, 

for every j G J. 

On orbits of dimension one, L behaves as a multiple of a real vector field (one- 
dimensional behavior); on orbits of dimension two, L has the behavior of d on 
a Riemann surface S C O, but on the complement 0\T, which is a union of 
curves with different endpoints along which Re L and Im L are both tangent (de- 
generacy), L behaves again as a multiple of a real vector field (one-dimensional 
behavior). As shown in MHT 19961 (main Theorem 7.3 there) a relatively closed 
set C C is everywhere removable if and only if C does not disconnect almost 
every curve on which L has one-dimensional behavior and furthermore, the inter- 
section of C with almost every (reduced) orbit of dimension two has zero analytic 
capacity for its natural holomorphic structure. 

Open problem 2.24. Study removability of a C°° locally integrable involutive 
structure of rank X ^ 2 in terms of analytic capacity. 
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2.25. Cartan-ThuUen argument and a local continuity principle. The Behnke- 
Sommer Kontinuitatssatz, alias Continuity Principle, states informally as follows 
( IIShl990l ). Let {T,^)^^^^ be a sequence of complex manifolds with boundary 
(9S^ contained in a domain of C". If S^, converges to a set Sqo C 17 and 
if 3Soo is contained in 17, then every holomorphic function / G 0{Q) extends 
holomorphically to a neighborhood of the set Sqo in C". The geometries of the 
and of Soo have to satisfy certain assumptions in order that the statement be 
correct; in addition, monodromy questions have to be considered carefully. For 
applications to removable singularities in IIMP2006all . the rigorous Theorem 2.27 
below is formulated, with the being embedded analytic discs. 

We denote by z = {zi, . . . , Zn) the complex coordinates on C" and by |z| = 
maxisjj^n \zi \ the polydisc norm. If C C" is an arbitrary subset, for p > 0, we 
denote by 

Vp{E) := \J{zeC^:\z-p\<p} 

the union of all open polydiscs of radius p centered at points of E. 

Lemma 2.26. ( IIMel997ll ) Let Qbea nonempty domain ofC^ and let A : A ^ 
A E 0{A) n C^(A), be an analytic disc contained in having the property that 
there exist two constants c and C with < c < C such that 

c|C2-Ci|<l^(C2)-^(Ci)l<C|C2-Ci|, 

for all distinct points Ci , C2 G A. Set 

p:=inf{|z-^(C)| : z e d^, C G 5A}, 

namely p is the polydisc distance between A{d/\) and dQ, and set a := pc/2C. 
Then for every holomorphic function f E 0{Q), there exists a holomorphic func- 
tion F G 0{Va{A{K))) such that F = f on Va{A{dA)). 




The inequalities involving c and C are satisfied for instance when A is C 
embedding of A into 11. Whereas A{A) is contained in 17, the neighborhood 
Va{A{A)) is allowed to go beyond. We do not claim that the two functions 
/ G 0(17) and F G 0{VaiA(A))) stick together as a holomorphic function 
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globally defined in 17 U Va{A{A)). In fact, n Va{A{A)) may have several 
connected components. 




The intersection Q, n Va-{A{A)) may be not connected 



In the geometric situations we encounter in ||Mel997| IMP 1 999 [ IMP20021 
IMP2006al . after shrinking $7 somehow slightly to some subdomain 17', we shall 
be able to insure that the intersection 17' n Vcr{A{A)) is connected and that the 
union 17' U Va{A(A)) is still significantly "bigger" than 17. 

Proof of Lemma 2.26. Let / G 0(17). For G A ai^bitrary, we consider the 
locally converging Taylor series X^^gis^n fa {z — ^(C))" of / at ^(C)- For p' with 
< p' < p arbitrarily close to p, since Vpi{A{dA)) ^ 17, the quantity 

Mp,{f) :=sup{|/(z)| : z G Vp,{A{dA))} < oo, 

is finite (it may explode as p' — > p). Thus, Cauchy's inequality on a polydisc of 
radius p' centered at an arbitrary point A(e*^) of dA yields 



1 



a! 



Mp'if) 



P' 



uniformly for all e*^ G dA. Then the maximum principle applied to the function 

Q ^ ^Q_^J {A{C,)) holomorphic in A provides the crucial inequalities (Cartan- 
ThuUen argument): 



I/a 



1 



dMf 



1 



sup 

a'. e'OedA 



QHf 



dz" 



{A{e^')) 



Consequently, the Taylor series of / converges normally in the polydisc Ap{A{()) 
of center A{(^) and of radius p, this being true for every A{Q G ^(A). These 
series define a collection of holomorphic functions -F4{C),p ^ C'(Ap(yl(C))) 
parametrized by ^ G A. We claim that the restrictions of all these functions 
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to the smaller polydiscs A'^{A{C)) stick together in a well defined holomorphic 
function F G 0{Va{A(K))). 

Indeed, assume that two distinct points Ci , C2 S A are such that the intersection 
of the two small polydiscs AJJ(A(Ci)) n A"(^(C2)) is nonempty, so |A(C2) - 
y4(Ci)| < 2 a. It follows that for every ( belonging to the segment [Ci,C2], we 
have: 

IC - Cil ^ IC2 - Cil < l^(C2) - A{Ci)\/c < 2a/c 

whence 

\A{C)-A{C,)\<C\C-Ci\<2Ca/c = p. 

This means that the curved segment ^([^1,^2]) is contained in the connected 
intersection of the two large polydiscs A^{A{(i)) n A^{A{(2))- In a small 
neighborhood of A{(i) and of A{(^2), the two holomorphic functions -F4(Ci),p 
and F4(C2),p coincide with / by construction. Thanks to the principle of ana- 
lytic continuation, it follows that they even coincide with / in a thin connected 
neighborhood of the segment (^2])- Again thanks to the principle of an- 

alytic continuation, Fj^(^(^^^^p and Fj^(^(^^^^p coincide in the connected intersection 
Ap{A{Ci)) n A^(^(C2))- It follows that they stick together to provide a well 
defined function -Pa(Ci),A(C2),p "^^at is holomorphic in A'^{A{(i)) U A^(A(C2))- 
In conclusion, the restriction ^yi(Ci),A(C2),p|A<,(yi(Ci))uA<,(yi(C2)) holomorphic in 
the union of the two small polydiscs Aa-{A{(i)) U Aa-{A{C,2)), whenever the 
intersection A^{A{(i)) n Act(^(C2)) is nonempty. This proves that all the re- 
strictions A"(A(C)) ^^^^^ together in a well defined holomorphic function 

In the next theorem (a local continuity principle often used in HMe 19971 
IMP1999[lMP2002llMP2006al ). ^i(A) C U, but contrary to Lemma 2.26, ^(A) 
may well be not contained in Q for s < 1; nevertheless, the boundaries As{dA) 
must always stay in Q. 

Theorem 2.27. f' IIMel997ll ) Let Qbe a nonempty domain in C" and let : A — > 

C", As € 0{A) n C^(A), be a one-parameter family of analytic discs, where 
s G [0, 1]. Assume that there exist two constants Cg and Cg with Q < Cg < Cs such 
that 

cs IC2 - Cil < l^(C2) - A(Ci)| < Cs IC2 - Cil, 

for all distinct points (1,(2 G A. Assume that yli(A) C il., set 

Ps :=inf{|z-^(C)| : z G 917, C G 5A}, 

namely ps is the polydisc distance between j4<j(9A) and dfl, and set as ■= 
PsCs/2Cs- Then for every holomorphic functions f G 0{0,), and for all s G [0, 1], 
there exist holomorphic functions Fs G OiVa (^^(A))) such that Fg = f in 
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Proof. Let X C [0, 1] be the connected set of real sq such that the statement is true 
for all s with so ^ s ^ 1- By Lemma 2.26, we already know that 1 G X. We want 
to prove that X = [0,1]. It suffices to prove that X is both open and closed. 

The fact that X is closed follows by "abstract nonsense". We claim that X is 
also open. Indeed, let sq G X and let si < sq be such that As^{/S.) is contained in 
Va^Q (ylso(A)). Since = / in V^^^ (^so {9/S.)) and since the polydisc distance 
between As^ {dA) and dQ is equal to , it follows as in the first part of the proof 
of Lemma 2.26, that the Taylor series of Fs^ at arbitrary points of the form Ag-^ (C), 
C G A, converges in the polydisc A"^^ (A^^ (C)). This gives holomorphic func- 
tions -F4((),p^^ G O (Ap^^ {Ag^ (C))) , for every C £ A. Reasoning as in the second 
part of the proof of Lemma 2.26, we obtain a function Fg-^ G ©(Vcr^^ {Ag-^ (A))) 
with Fg-^ = / in V^^^ (A^i (5A)). This shows that X is open, as claimed and 
completes the proof. □ 

2.28. Singularities as complex hypersurfaces. Let O C C" (n ^ 2) be a do- 
main. A typical elementary singularity in 17 is just the zero set Zj := {/ = 0} of 
a holomorphic function / G 0{Q) since for instance, the functions 1//^, k ^ 1, 
and e^^^ are holomorphic in 0,\Zf and singular along Zj. Because C is alge- 
braically closed, the closure in 17 of such Zj's necessarily intersects 517. Early 
in the twentieth century, the Italian mathematicians Levi, Severi and B. Segre 
( IISel932| ) interpreted Hartogs' extension theorem as saying that compact sets 
K C ^ are removable, confirming the observation Zf n 517 / 0. 

Definition 2.29. (i) A relatively closed subset C of a domain 17 C C" is called 
removable if the restriction map 0{Q) C'(17\C) is surjective. 

(ii) Such a set C is called locally removable if for every p ^ C, there exists an 
open neighborhood Up of p in 17 such that the restriction map C((C/pUf])\C) — > 
0{Q,\C) is surjective. 

Under the assumption that C is contained in a real submanifold of 0, the gen- 
eral philosophy of removable singularities is that a set too small to be a Zj (viz. 
a complex (n — 1) -dimensional variety) is removable. The following theorem 
collects five statements saying that C is removable provided it cannot contain 
any complex hypersurface of 17. Importantly, our submanifolds of 17 will al- 
ways be assumed to be embedded, namely for every p ^ N, there exist an open 
neighborhood Up of p in 17 and a diffeomoiphism il^p : Up ^ M^" such that 

ijpiNnUp) =MdimAf X {0}. 

Theorem 2.30. Let Q be a domain of C" (n ^ 2) and let C C ^ be a relatively 
closed subset. The restriction map 0(17) 0(17\(7) is surjective, namely C is 
removable, under each one of the following five circumstances. 

(rml) C is contained in a connected submanifold A^ C 17 of codimension ^ 3. 
(rm2) H2"-2(C7) = o. 
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(rm3) C is a relatively closed proper subset of a connected submanifold 
N (ZVL of CO dimension 2. 

(rm4) C = N is a connected submanifold N C ^ that is not a complex 
hypersurface ofVl. 

(rmS) C is a closed subset of a connected real hypersurface C 17 that 
does not contain any CR orbit of M^. 

In (rml) and in (rm2), C is in fact locally removable. In (rmS), two kinds of 
CR orbits coexist: those of real dimension (2n — 2), that are necessarily complex 
hypersurfaces, and those of real dimension (2n — 1), that are open subsets of 
M. It is necessary to exclude them also. Indeed, if for instance Q, is divided in 
two connected components Q,^ by a globally minimal M^, taking C = M^, 
any locally constant function on Q,\M^ equal to two distinct constants in 
does not extend holomorphically through A4^. The proof of the theorem is 
elementar>@ and we will present it in §2.34 below, as a relevant preliminary to 
Theorems 4.9, 4.10, 4.31 and 4.32, and to the main Theorem 1.7 of IIMP2006all ). 

We mention that under the assumption of local boundedness, more massive sin- 
gularities may be removed. An application of Theorem 1.9(ii) to several complex 
variables deserves to be emphasized. 

Theorem 2.31. ( IIHP1970II ) If n C is a domain and if C C Q is a rela- 
tively closed subset satisfying H^"'~^(C) = 0, then C is removable for functions 
holomorphic in Q\C that are locally bounded in Q. 

Following IIStul989l and MLu 19901 . we now provide variations on (rm2). Any 
global complex variety of codimension one in C" is certainly of infinite (2n — 2)- 
dimensional area. 

Theorem 2.32. ( IIStul989ll ) Every closed set C C satisfying H'^'^''^ [C] < oo 
is removable for ©(C"). 

The result also holds true in the unit ball ]B„ of C", provided one computes 
the (2n — 2) -dimensional Hausdorff measure with respect to the distance function 
derived from the Bergman metric ( IIStul989i ). Also, if S is an arbitrary com- 
plex fc-dimensional closed submanifold of C", every closed subset C C S with 
H2'^-2(C) < oo is removable for C'(S\C) ( IIStul989ll ). 

A finer variation on the theme requires that H^"^~^(C n i?B„) does not grow 
too rapidly as a function of the radius — > oo. For instance ( IIStul989ll ). a 
closed subset C C that satisfies H'^{C n fiB„) < cR^ for all large R is 

2 

removable, provided c < It is expected that c < vr is optimal, since the line 
L := {(21,0)} satisfies H'^{Lr^RB2) =ttR'^. 



Some refinements of the statements may be formulated, for instance assuming in 
(rm3) and (rm4) that N is and has some metrically thin singularities ( ||CStl994|| ). 
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Yet another vaiiation, raised in IIStul989ll . is as follows. Consider a closed 
set C in the complex projective space Pn{C) (n ^ 2) such that the Hausdorff 
(2n — 2) -dimensional measure (with respect to the Fubini-Study metric) of C is 
strictly less than that of any complex algebraic hypersurface of Pn{C). Is it true 
that C is a removable singularity for meromorphic functions, in the sense that 
every meromorphic function on Pn{C)\C extends meromorphically through C ? 
This question was answered by Lupacciolu. 

Let dpsiz, w) denote the geodesic distance between two points z,w ^ Pn{C) 
relative to the Fubini-Study metric and let Hpg denote the ^-dimensional Haus- 
dorff measure in Pn{C) computed with dps- Given a nonempty closed subset 
C C P„(C), define: 

max^gPn(C) dFs{z,C) _ max^sp^(c) dFs{z,C) ^ ^ 
^^^z,w€Pn{C)dFs{z,w) diamFs(i^n(C)) 

If the Fubini-Study metric is normalized so that volP„(C) = 1, the (2n — 2)- 
dimensional volume of an iiTcducible complex algebraic hypersurface S C Pn{C) 
is equal to deg^ and Hll'^iC) = (4/7r)"-i (n - 1)! degV. It follows that the 
minimum value of H^"~^(S) is equal to (4/7r)"~^ (?i — 1)! and is attained for 
V equal to any hypeiplane of P„(C). Let M denote the sheaf of meromorphic 
functions on P„(C). 

Theorem 2.33. ( MLu 19901 ) Let C C Pn(C) be a closed subset such that 

^ItHC) < (4A)"-i (n - 1)! 

Then the restriction map j\4{Pn{C)) — > A^(P„(C)\C) is onto. 

2.34. Proof of Theorem 2.30. We claim that we may focus our attention only on 
(rm2) and on (rmS). Indeed, since a submanifold N C 0. of codimension ^ 3 
satisfies H^"~^(A^) = 0, (rml) is a corollary of (rm2). 

In both (rm3) and (rm4), we may include N in some hypersurface of 
C'*, looking like a thin strip elongated along N. We claim that C then does not 
contain any CR orbit of any such M^, so that (rmS) applies. Indeed, CR orbits of 
being of dimension (2n — 2) or (2n — 1) and C being already contained in the 
(2n — 2) -dimensional N C Af^, it could only happen that C = N = 'E identifies 
as a whole to a connected (CR orbit) complex hypersurface S C M^. But this is 
excluded by the assumption that C / in (rm3) and by the existence of generic 
points in (rm4). 

Firstly, we prove (rm2). We show that C is locally removable. Let p ^ C 
and let Pp C ^2 be a small open ball centered at p. By a relevant application of 
Proposition 1.2(5), one may verify that for almost every complex line I passing 
through p, the intersection ^ n Pp n C is reduced to {p}. Choose such a line 
li. Centering coordinates at p and rotating them if necessary, we may assume 
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that £i = {(2:1, 0, . . . , 0)}, whence for e > small and fixed, the disc ^^(C) := 
(e C, 0, . . . , 0) satisfies Ae{dA) n C = 0. 

Fix such a small eq > and set pQ := dist (A£p(9A),C) > 0. For r = 
(T2,---,r„) G C"-^ satisfying |r| < ^ po, set ^^^^^(C) := {eoC,T2, . . . ,Tn). 
Letting s € [0, f], we interpolate between vIeq.o and ^£o,r by defining 

Ao,T,s{C) ■= {eoC,ST2,...,STn). 

Since |r| < ^ po> these discs all satisfy dist (^^^^^-^^(^A), ^ ^ po- Since the 
embedded disc Ae(,^T- i(A) is 2-dimensional and since H^"~^(C) = 0, Proposi- 
tion 1.2(5) assures that for almost every r with |r| < ^ pQ, its intersection with 
C is empty. Thus, we may apply the continuity principle Theorem 2.27, setting 
Cg = ^eq, Cg = 2 So and ps := ^ po uniformly for every s G [0,1], whence 
<7s = I po independently of the smallness of r: for every / G 0{U\C), there 
exists Fo G 0(Vpo{Aeo,r,o(^))) with Fq = / in Vpo (^eo,r,o(9A)). But since 

8 8 

H'^"-~'^{C) = 0, for every connected open set V C ^2, the intersection V n {^\C) 
is also connected (Proposition 1.2(4)), so Fq and / stick together as a well defined 
function holomorphic in J] U Vn (Aj(j^t-,o(^))- If t was chosen sufficiently small, 

8 

it is clear- that p = G C" is absorbed in Vn (j4eQ o(^))> hence removable. 

8 

Secondly, we prove (rmS). Let C C containing no CR orbit and define 
C := c C closed, V / G 0{n\C),3f' G 0{n\C') with/'|^^^ = /}. 
Lemma 2.35. IfC[,C'2 G C, then C( n G C. 

Proof. Let /j G 0{Q\C'j), j = 1,2, with f'-\^^^ = f. We claim that f[ and 
match up on C\(C{ U C2), hence define together a holomorphic function /(g G 
C'(J7\(C{ n C2)) with /i2|n\c ~ Ii^deed, choose an arbitrary point p G 
C\(CJ U C2). There exists a small open ball Bp centered at p with Bp n (CJ U 
C'2) = 0. Since /( = = / at least in the dense subset Bp\M^ of n Bp, by 
continuity of /{ and of f'2 in necessarily /((p) = /2(p)- D 

Next, we define 

c'ec 

Intuitively, C is the "nonremovable core" of C. By the lemma, for every 
/ G 0{^\C), there exists / G 0(^\C) with J\^^^ = f. To prove (rmS), 

we must establish that C = 0. Reasoning by contradiction, we assume that 
C ^ ^ and we apply to C := C the lemma below, which is in fact a corol- 
lary of Trepreau's Theorem 2.4(V). Of course, C cannot contain any CR orbit of 
Remind (§1.27(111), §4.9(111)) that for us, local CR orbits are not germs, but 
local CR submanifolds of a certain small size. 
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Lemma 2.36. Let C C" (n 2) be a hypersurface and let C C be a 

closed subset containing no CR orbit of M^. Then there exists at least one point 
p C such that for every neighborhood Vp of p in M^, we have: 

Vp'no'SUM\p)^c, 

and in addition, all such points p are locally removable. 

Then / extends holomorphically to a neighborhood of all such points p ^ C, 
contradicting the definition of C, hence completing the proof of (rmS). 

Proof. If ©^^(M^j^) C C for every q ^ C, then small complex-tangential 
curves issued from q necessarily remain in 0^1^(1/1 , q), hence in C, and pursumg 
from point to point, global complex-tangential curves issued from q remain in C, 
whence OcRiM^, q) C C, contrary to the assumption. 

So, letp G C with ©[^^(M^jp) {Z! C. To pursue, we need that is minimal 
at p. Since is a hypersurface, it might only happen that 0''^'^{M^ , is a local 
complex hypersurface, a bad situation that has to be changed in advance. 

Fortunately, without altering the conclusion of the lemma (and of (rmS)), we 
have the freedom of perturbing the auxiliary hypersurface M^, leaving C fixed of 
course. Thus, assuming that Ocr{M^ ,p) is a complex hypersurface, we claim 
that there exists a small (in norm) deformation Mj of supported in a neigh- 
borhood of p with D C such that is minimal at p. 

Indeed, let {qk)k&n be a sequence of points tending to p in Oq'^{M^,p) with 
qk ^ C. To destroy the local complex hypersurface Oq'^{M^ ,p), it suffices to 
achieve, by means of cut-off functions, small bump-deformations of M centered 
at all the qk', it is easy to write the technical details in terms of a local graphed 
representation v = (p^{z, u) for M^. Outside a small neighborhood of the union 
of the qk, coincides with M^. Then the resulting is necessarily minimal 
at p, since if it where not, the uniqueness principl^ for complex manifolds would 
force C'^|j(Af\p) = ©^^(M],^), but M] does not contains the qt. 

So we can assume that is minimal at every point p G C at which 
0(^'j^{M^,p) (fi C. Let Bp C be a small open ball centered at p with 
Bp n C C'^|j(M\p). We will show that olvL\C) extends holomorphi- 
cally to Bp. By assumption. Bp n C, hence Bp\C is connected, a fact that 
will insure monodromy. 

Fixing Vp G TpC"\{0} with Vp TpM^, we consider the global translations 

M^:=M^ + sVp, sEM, 

of M'^. Let / G 0{n\C) be arbitrary. For small s / 0, D Bp does not 
intersect M^, hence the restriction f\M}nBp is a CR function on n Bp (but 
/ImIob possible singularities at points of C n Bp). 



Minimalization at a point takes strong advantage of the rigidity of complex hyper- 
surfaces in this argument. 
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With Up := M^nBp, Theorem 2.4(V) says that C^j^iUp) extends holomorphi- 
cally to some one-sided neighborhood u>^ of at p. Reorienting if necessary, 
we may assume that the extension side is uj~ and that p + svp S for s > 
small. The statement and the proof of Theorem 2.4(V) are of course invariant by 
translation. Hence C^^{Up -\- sVp) extends holomorphically to lo~ + sVp, for 
every s > 0. It is geometrically clear that for s > small enough, uj" + sVp con- 
tains p. Thus /I , fi^Q extends holomorphically to a neighborhood of p for such 
s. Monodromy of the extension follows from the fact that B'p\C is connected for 
every open ball B'^ centered at p. This completes the proof of the lemma. □ 

2.37. Removability and extension of complex hypersurfaces. Let c C" be 

a domain. Theorem 2.30 (rm4) shows that a connected 2-codimensional subman- 
ifold C is removable provided it is not a complex hypersurface, or equiv- 
alently, is generic somewhere. Conversely, assume that Q is pseudoconvex and 
let i7 C be a (not necessarily connected) closed complex hypersurface. Then 
Q,\H is (obviously) locally pseudoconvex at every point, hence the characteriza- 
tion of domains of holomorphy yields a function / G 0{Q,\H) whose domain of 
existence is exactly ^}\H. Thus, H is nonremovable. But in a nonpseudoconvex 
domain, closed complex hypersurfaces may be removable. 

Example 2.38. For e > small, consider the following nonpseudoconvex sub- 
domain of IB 2, defined as the union of a spherical shell together with a thin rod of 
radius e directed by the ?/2-axis: 

:= {1/2 < + |z2p < 1} U (^2 n {xl + yl + xl< e^}) . 
Then the intersection of the zi-axis with the spherical shell, namely 

H := {{zi,0) : 1/2 < |zi| < l}, 

is a relatively closed complex hypersurface of 0^ homeomorphic to an open an- 
nulus. We claim that H is removable. 

Indeed, applying the continuity principle along discs parallel to the zi-axis, 
©(rig) extends holomorphically to M2\{z2 = 0}. Since the open small disc 
{(2;i,0) : l^il < e}, considered as a subset of the closed complex hypersurface 
^ofB2 defined by 

H:={{zi,0) : \zi\ < 1} 

is contained in the thin rod, hence in f]^. Theorem 2.30 (rm3) finishes to show 
that 

Ein,\H) = Ein,)=M2. 

In such an example, we point out that the closed complex hypersurface H C 
extends as the closed complex hypersurface H C E{Qs\H) but that the intersec- 
tion 

Hnns = {izi,0) : <e} J{(zi,0) : 1/2 < < l} 
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is Strictly bigger than H. 

Problem 2.39. Understand which relatively closed complex hypersurfaces of a 
general domain Vl C C" are removable. 

We thus consider a (possibly singular and reducible) closed complex hypersur- 
face H of 0. Basic properties of complex analytic sets ( IIChl991ll ) insure that 
H = Uje J decomposes into at most countably many closed complex hyper- 
surfaces Hj C r2 that are irreducible. 

Definition 2.40. We say that Hj allows an H -compatible extension to E{Q) if 
there exists an irreducible closed complex hypersurface Hj of E(il) extending Hj 
in the sense that Hj C Hj HQ whose intersection with J7 remains contained in 
H: 

Hj nnc U Hj,. 

j'eJ 

The principle of analytic continuation for irreducible complex analytic sets 
( IIChl991i ) assures that Hj has at most one i7-compatible extension. On the 
other hand, Hj may be an i7-compatible extension of several Hj, . In the above 
example, the removable annulus H had no i^^-compatible extension to E{Q). 

Theorem 2.41. ( IID11977[|JaPf2000ll ') Let Q C (n ^ 2) be a domain and let 
H = UjeJ closed complex hypersurface of Vt, decomposed into irre- 

ducible components Hj. Set 

•/comp := {j G J : Hj allows an if-compatible extension Hj to E(0)}. 
Then 

E(0\i7) = E(0)\ U H,. 

3^"^ comp 

In particular, H is removable (resp. nonremovable) if and only if J comp = {resp. 

J comp 7^ 0)- 

This statement was obtained after a chain of generalizations originating from 
the classical results of Hartogs IIHal909ll and of Ofa IIOkl9341 . In IIGR1956II it 
was proved for the case that H is of the form ilCiH, H C E(0), and in UNis 196211 
under the additional assumption that E{^\H) is a subset of E(0) (a priori, it is 
only a set over E(r2)). Actually Theorem 2.41 was stated in IID11977II even for 
Riemann domains U. But it was remarked in IIJaPf2000l (p. 306) that the proof 
in IID11977I is complete only if the functions of 0{Q) separate the points of Q, 
i.e. if Q can be regarded as a subdomain of E(17). Actually the proof in IID11977II 
starts from the special case where is a Haitogs figure, which can be treated by a 
subtle geometric examination. Then a localization argument shows that extension 
of hypersurfaces which are singularity loci of holomorphic functions cannot stop 
when passing from to E{Q). But in the nonseparated case, the global effect 



HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



227 



of identifying points of interferes nastily, and it is unclear how to justify the 
localization argument. The final step for general Riemann domains was achieved 
by the second author by completely different methods. 

Theorem 2.42. ( IIPo2002ll ) Let tt : X ^ C"" be an arbitrary Riemann domain, 
and let H C X be a closed complex hypersurface. Denote by a : X ^ E(X) the 
canonical immersion of X into E{X). Then there is a closed complex hypersur- 
face H o/'E(X) with a~^{H) C H such that 

E{X\H) = E{X)\H. 

Let us briefly sketch the main idea of the proof ( IIPo2002l ). The essence of the 
argument is to reduce extension of hypersurfaces to that of meromorphic func- 
tions. For every pseudoconvex Riemann domain it : X —>■ C", there exists 
/ G 0{X) n L'^{X) having X as domain of existence whose growth is con- 
trolled by some power of the polydisc distance to the abstract boundary dX. At 
boundary points where dX can be locally identified with a complex hypersurface, 
/ has just a pole of positive order. One can deduce that those hypersurfaces H 
of X along which some holomorphic function on X\H becomes singular can be 
represented as the polar locus of some meromorphic function g defined in X. But 
g extends meromorphically to E(X), and the polar locus of the extension yields 
the desired extension of H. 

§3. Hulls and removable singularities at the boundary 

3.1. Motivations for removable singularities at the boundary. As already ob- 
served in Section 1, beyond the harmonious realm of pseudoconvexity, the general 
problem of understanding compulsory holomorphic (or CR) extension is intrinsi- 
cally rich and open. Some elementary Baire category arguments show that most 
domains are not pseudoconvex, most CR manifolds have nontrivial disc-envelope, 
and most compact sets have nonempty essential polynomial hull. Hence, the Grail 
for the theory of holomorphic extension would comprise: 

• a geometric and constructive view of the envelope of holomorphy of most 
domains, following the Behnke-Sommer Kontinuitatssatz and Bishop's 
philosophy; 

• a clear coiTcspondence between function-theoretic techniques, for in- 
stance those involving d arguments, and geometric techniques, for in- 
stance those involving families of complex analytic varieties. 

Several applications of the study of envelopes of holomorphy appear, for in- 
stance in the study of boundary regularity of solutions of the 9-complex, in the 
complex Plateau problem, in the study of CR mappings, in the computation of 
polynomial hulls and in removable singularities, the topics of this Part VI and 
of IIMP2006all . 
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In the 1980's, rapid progress in the understanding of the boundary behavior of 
holomorphic functions led many authors to study the structure of singularities up 
to the boundary. In §2.28, we discussed removability of relatively closed subsets 
C of domains C C", i.e. the problem whether 0{Q) —>■ 0{fl\C) is surjective. 
Typically C was supposed to be lower-dimensional and its geometry near dQ was 
irrelevant. Now we assume U to be bounded in C" (n ^ 2) and we consider 
compact subsets K of Jl, possibly meeting d^l. 

Problem 3.2. Find criteria of geometric, or of function-theoretic nature, assuring 
that the restriction map 0{Q) 0{0,\K) is surjective. 

If K C ^ n dQ = and Q\K is connected, surjectivity follows from the 
Hartogs-Bochner extension Theorem 1.9(V). Since this theorem even gives exten- 
sion of CR functions on dO,, it seems reasonable to ask for holomorphic extension 
of CR functions on dQ,\K, and then it is natural to assume that K is contained in 
d^l. Hence the formulation of a second trend of question^ 

Problem 3.3. Let K is a compact subset ofdVL such that dVt\K is a hypersurface 
of class at least C^. Understand under which circumstances CR functions of class 
or L'l^^ on d^l\K extend holomorphically to 0. 

A variant of these two problems consists in assuming that functions are holo- 
morphic in some thin (one-sided) neighborhood of dQ\K. In all the theorems that 
will be surveyed below, it appears that the thinness of the (one-sided) neighbor- 
hood of dQ\K has no influence on extension, as in the original Hartogs theorem. 
In this respect, it is of interest to immediately indicate the connection of these two 
problems with the problem of determining certain envelopes of holomorphy. 

In the second problem, the hypersurface dQ\K is often globally minimal, a 
fact that has to be verified or might be one of the assumptions of a theorem. For 
instance, several contributions deal with the paradigmatic case where dQ is at least 

and strongly pseudoconvex (hence obviously globally minimal). Then thanks 
to the elementary Levi-Lewy extension theorem (Theorem 1.1 8(V), lemma 2.2(V) 
and §2. 10(V)), there exists a one-sided neighborhood V{dQ\K) of dQ\K con- 
tained in Q to which both C(jj^{dQ\K) and Lj'^^ ^j^{dQ\K) extend holomorphi- 
cally. The size of V{dQ\K) depends only on the local geometry of dQ, because 
V{di}\K) is obtained by gluing small discs (Part V). In fact, an inspection of the 
proof of the Levi-Lewy extension theorem together with an application of the con- 
tinuity principle shows also that the envelope of holomorphy of any thin one-sided 
neighborhood V'{dQ\K) (not necessarily contained in Q !) contains a one-sided 
neighborhood V{dQ\K) of dQ\K contained in the pseudoconvex domain that 
has a fixed, incompressible sizCJ- 

CR distributions may also be considered, but in the sequel, we shall restrict consid- 
erations to continuous and integrable CR functions. 

To be rigorous; for every holomorphic function / e O (V' {d^l\K)) , there exists 
a holomorphic function F E 0(y{dfl\K)) that coincides with / in a possibly smaller 
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As they aie formulated, the above two problems turn out to be slightly too re- 
strictive. In fact, the final goal is to understand the envelope E(V(50\i^)) , or at 
least to describe some significant part of E(V(50\-fC)) lying above Q. Of course, 
the question to which extent is the geometry of E(V(OrJ\A')) accessible (con- 
structively speaking) depends sensitively on the shape of Q. Surely, the strictly 
pseudoconvex case is the easiest and the best understood up to now. In what fol- 
lows we will encounter situations where E(y{dQ\K)^ contains il\K, for some 

subset K C defined in function-theoretic terms and depending on K C 517. We 
will also encounter situations where E{y{Q\K)^ is necessarily multisheeted over 
C". In this concern, we will see a very striking difference between the complex 
dimensions n = 2 and n ^ 3. 

In the last two decades, a considerable interest has been devoted to a subprob- 
lem of these two problems, especially with the objective of characterizing the 
singularities at the boundary that are removable. 

Definition 3.4. In the second Problem 3.3, the compact subset K C 50 is 
called CR-removable if for every CR function / G C(^j^{d^\K) (resp. / G 
^L,cr('5^\^))' *ere exists F G 0{n) D C°{Tl\K) (resp. F G 0{n) D 
Hf^^{Q\K)) with F\gQ\x = / (resp. locally at every point p G dQ\K, the 
^ioc CR boundary value of F equals /). 

Before exposing and surveying some major results we would like to mention 
that a complement of information and different approaches may be found in the 
two surveys IIStul993[ICStl994L in the two monographs |Kyl995tlLtT997l and 



in the articles IIStul981[ ILT1984[ ILul986[ ILul987[ IJol988[ |Ltl988, Stul9891 



Kyl990VKyl991'/Stul991!'FS1991VJol992:'KN1993:mi993',T:S1993,iail994l 
AC1994, Jol995, KR 1995, Jo 1999a, Jol999b, JS2000. JP2002. JS20041. 

3.5. Characterization of removable sets contained in strongly pseudoconvex 
boundaries. Taking inspiration from the pivotal Oka theorem, one of the goals 
of the study of removable singularities ( MS tu 199311 ') is to characterize removability 
in function-theoretically significant terms, especially in terms of convexity with 
respect to certain spaces of functions. In the very beginnings of Several Com- 
plex Variables, polynomial convexity appeared in connexion with holomorphic 
approximation. According to the Oka- Weil theorem ( IIAW1998II ). functions that 
are holomorphic in some neighborhood of a polynomially convex compact set 
K C C" may be approximated uniformly by polynomials. Later on, holomorphic 
convexity appeared to be central in Stein theory ( ||Hdl973ll ). one of the seminal 
frequently used idea being to encircle convex compact sets by convenient analytic 
polyhedra. 



one-sided neighborhood V" {dft\K) C V'{dn\K). Details of the proof (involving a 
deformation argument) will not be provided here {see ||Mel997IIJol999al ). 
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The notion of convexity adapted to our pruposes is the following. By 
we denote the ring of functions that are holomorphic in some neighborhood of the 
closure of a domain C C". As in the concept of germs, the neighborhood 
may depend on the function. 

Definition 3.6. Let $7 d C" be a bounded domain and let K C $7 be a compact 
set. The 0{Q)-convex hull of K is 



If K = Kqij^y then K is called O ($7) -convex. 

If Q. is strongly pseudoconvex, a generalization of the Oka- Weil theorem shows 
that every function which is holomoiphic in a neighborhood of some 0{Vt)- 
convex compact set K d may be approximated uniformly on K by functions of 
0{Q.) (nevertheless, for nonpseudoconvex domains, this approximation property 



We may now begin with the formulation of a seminal theorem due to Stout that 
inspired several authors. We state the CR version, due to LupaccioliQ 

Theorem 3.7. ( IIStul981[ ILul986[ IStul993ll ) In complex dimension n = 2, a 
compact subset K of a strongly pseudoconvex boundary dQ ^ is CR- 
removable if and only if it is 0{Q)-convex. 

The "only if" part is the easiest, relies on a lemma due to Slodkowski ( ||RS1989[ 
IStul993ll ) and will be presented after Lemma 3.11. Let us sketch the beautiful key 
idea of the "if" part ( IIStul981ilLuT986llStul993ilPol997ll ). 

From §1.7(V), remind the expression of the Bochner-Martinelli kernel: 



Let C be a thin strongly pseudoconvex neighborhood of 0. By means of 
a fixed function g G 0{A4), it is possible to construct some explicit primitive of 
BM as follows. This idea goes back to Martinelli and has been exploited by Stout, 



Indeed, consider for instance the Hartogs figure r2 :={|zi|<l, |z2|<2}u{l^ 
\zi\ < 2,1 < \z2\ < 2} inC^. Then the annulus = {zi = 1,1 ^ \z2\ < 2)} C dnis 
C'{0)-convex. We claim that the function g := l/z2, holomorphic in a neighborhood of 
K, cannot be approximated on K by functions / e 0{il). Indeed, by Hartogs extension 
0(Ti) = ©({l^il < 2, \z2\ < 2}), which implies that every / e 0(11) has to satisfy the 
maximum principle on the disc {zi = 1, \z2\ ^ 2)} D K. Rounding off the corners, we 
get an example with dfl G C°°. 

^^Said differently, the envelope of holomorphy of an arbitrarily thin (interior) one-sided 
neighborhood of dil\K is one-sheeted and identifies with fi. 




BM(C,^) 



1 



(C2 - Z2) dCi - (Ci - zi) dC2 A dCi A dC2. 



(27ri)2|C-z|4 L 
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Lupacciolu, Leiterer, Laurent-Thiebaut, Kytmanov and others. By a classical re- 
sult ( HHeLe 198411 ). g admits a Hefer decomposition 

5(0 - g{z) = gi{C.,z)[(^i - zi] +g2{C.,z)[C2 -^2], 

with 51, 52 S 0{M. X M). Then a direct calculation shows that for z G fixed, 
the (0, 2)-form 



n (r\ 32{C, z){Ci -zi)- gi(C, z){C2 - ^2) ,^ . ,^ 
^aA^) = .^21^ 12 r ^/-\ TVl "'^^ ^ 

satisfies 

d^QgAO = k^gAO = ^^iC.z), 

on {C, ^ M. : g{C,) 7^ g{z)}, i-e. provides a primitive of BM outside some thin 
set. In for n ^ 3, there is also a similar explicit primitive. 

Let K C dn be as in Theorem 3.7 and fix z G n\K. By 0{n) -convexity 
of K, there exists g G 0{U) with g{z) = 1 and max^ogi^ 15(^^)1 < 1- After a 
slight elementai-y modification of g ( IIJol9951 IPol997ll ). one can insure that the 
set {^f G : 15(^)1 = l| is a geometrically smooth Levi-flat hypersurface 
of M. transverse to dQ. Then the region Q,g := ^ n \^\g\ > 1} has piecewise 
smooth connected boundary 

ao, = {dn n{\g\> 1}) [J{nn{\g\ = 1}) 

and its closure Qg in does not intersect K. 

Let / be an arbitrary continuous CR function on dQ\K. Supposing for a 
while that / already enjoys a holomorphic extension F G 0{Q) n C^(^Q\K), 
the Bochner-Martinelli representation formula then provides for every 2; G J7g the 
value 

F{z)= [ /(C)BM(C,^). 

JdQg 

Decomposing d^g as above and using the primitive @g,z, we may write 

F{z) = [ /(C) BM(C, z)+ [ fiC) d^QgAO- 

Jdnn{\g\>i} Jnn{\g\=i} 

Supposing f & and applying Stokes' theorertQto the (Levi-flat) hypersurface 
Q, n {l^fj = 1} with boundary equal to 50 H {\g\ = 1}, we get 

Fiz) = [ /(C) BM(C, z)+ [ /(C) OgAC). 

JdQn{\g\>l} Jdnn{\g\=i} 

But the holomorphic extension F of an arbitrary / G C^,^[d^\K) is still 
unknown and in fact has to be constructed ! Since the two integrations in the 



In the general case / e C*^, one shrinks slightly ftg inside fl, rounds off its corners 



and passes to the limit. 
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above formula are performed on parts of di^\K where / is defined, we are led to 
set: 

Fg{z) = [ /(C) BM(C, Z)+ [ /(C) QgAO, 

Jdnn{\g\>i} Jdnn{\g\=i} 

as a candidate extension of / at every z S 0,g. Since K is C'(r2)-convex, Q is 
the union of the regions ilg for g running in 0{Q), but these extensions Fg{z) do 
depend on g, because Qg^z does. The remainder of the proof ( IIStul9931IPol997ll ) 
then consists in: 

(a) verifying that Fg is holomorphic (the kernels are not holomorphic with 
respect to z); 

(a) showing that two differente candidates Fg-^ and Fg^ coincide in fact on 

(b) verifying that at least one candidate Fg has boundary value equal to / on 
some controlled piece of dQ,\K. 

The reader is referred to ||Stul9811ILul986[|Stul993l for complete arguments. 

In the above construction, the strict pseudoconvexity of Q, insured the existence 
of a Stein (i.e. pseudoconvex) neighborhood basis (A^j)^.^^ of Q which guaran- 
teed in turn the existence of a Hefer decomposition. It was pointed out by Ortega 
that Hefer decomposition (called Gleason decomposition in ||Qrl987ll ) holds on 
C°° pseudoconvex boundaries 50 d C", but may fail in the nonpseudoconvex 
realm. So, let (s C" be a bounded domain having boundary. Denote by 
A°°{n) := 0(0) n C°°(n) the ring of holomorphic functions in O that are 
up to the boundary. 

Theorem 3.8. ( IIQrl987ll ) Ifdn (e C" (n ^ 1) is C°° and pseudoconvex, then 
every g £ A°°{i}) has a decomposition 

n 

g{z) - g{w) = ^ gk{z,w)[zk - Wk], 

k=l 

with the gk G A°°{VL x Q). 

This decomposition formula also holds under the assumption that is a domain 
of holomorphy (having possibly nonsmooth boundary), but provided that has 
a basis of neighborhoods consisting of Stein domains. However, not every C°° 
weakly pseudoconvex boundary admits a Stein neighborhood basis, as is shown 
by the so-called worm domains (' IIDF1977IIFS 198711 ). 

Example 3.9. Furthermore, the above decomposition theorem fails to hold on 
general domains. Following ||Qrl987|| . consider the union VLi U 0.2 in of the 
two sets 

01 := {-4 < xi < 0, 122! < e""^} and 

02 := {0 ^ xi < 4, e-^/^i < \Z2\ < 1}. 
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The continuity principle along families of analytic discs parallel to the Z2~axis 
shows that the envelope of holomorphy of Oi U O2 contains ili U i^s, where 
:= {0 ^ xi < 4, \z2\ < 1}. 

The holomorphic mapping 2:2) := (e*^^, 22) is one-to-one from i7i U ^2 
onto its image R{Qi U ^2)- However, the extension of i? to U ^3 is not 
injective, because R takes the same value at the two points (ivr, G Jli UJ^s. 

If Theorem 3.8 were true on the domain R{i}i U Q2), pulling the decomposition 
formula back to O^i U i^2, it would follow that every g G 0{i^i U O2) has a 
decomposition 

g{z) -g{w)= gi {e' ' , w) [e^ '--e''^]+ 52 (e' ^ w) [z2 - W2] 

= gi{z,w)[e'''^ -e*^2] + g2{z,w)[z2 - W2]. 

Then the same decomposition would hold for every g G C'(r2iUr23),by automatic 
holomorphic extension of g,gi,g2. Choosing z = (— vr, e~^'^), w = (7r,e~^'^) 
and g such that g{z) / g{w) (g := z\ will do !), we reach a contradiction. 

Corollary 3.10. ( IIQrl987[ ILP2003i ) Every function holomorphic in a domain 
C C" enjoys the Hefer division property precisely when the envelope of holo- 
morphy ofVt is schlicht. 

The above results mean that a direct application of the integral formula ap- 
proach sketched above becomes impossible for domains having nonschlicht 
envelope. Nevertheless, in iLtlQSSI . using more general divison methods 
( l|HeLel984|| ). a Bochner-Martinelli kernel on an arbitrary Stein manifold was 
constructed that enabled to obtain Theorem 3.28 below, valid for nonpseudocon- 
vex domains. 

We conclude our presentation of Theorem 3.7 by exposing the "only if" of 
Theorem 3.7. 

Lemma 3.11. ( URS 19891 [StuT993l ) Let dn (^€?bea strongly pseudoconvex 
boundary and let K C 90 be a compact set. Then ^\Kqij^-^ is pseudoconvex. 

Taking for granted the lemma, by contraposition, suppose that K C dO. is 
not C)(r2)-convex, viz. K ^ ^o(n) show that K is not removable. It fol- 
lows from strict pseudoconvexity of dO. that VL n Kqiji-^ is nonempty ( ||Stul993ll ). 
Leaving K fixed, by deforming dO. away from Q., we may enlarge slightly O as 
a domain 0' D r2 with dVi' D K and Vl' D dQ.\K, having boundary dQ' 
close to do,, as illustrated. Since by the lemma, Q,\K^^-^-^ is pseudoconvex, it 

follows easily ( ||Stul993l ) that Q,'\K^^j^^ is also pseudoconvex. Consequently 
( IIH0I973II ). there exists a holomorphic function F' G 0[^l'\KQfj^^^ that does 
not extend holomorphically at any point of the boundary of Q.'\KQ^-^y The re- 
striction of F' to dQ\K is a CR function on di^\K for which K is not removable, 
since Q n -^'ofm / 0- 
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3.12. Removability, polynomial hulls and Cantor sets. A generalization of 
Theorem 3.7, essentially with the same proof (excepting notational complications) 
holds in arbitrary complex dimension re ^ 2. 

Theorem 3.13. ( IILuigSei IStoiggSD Let Q ^ C", n ^ 2, be a bounded pseu- 
doconvex domain such that O has a Stein neighborhood basis. If K d dVl is 
compact and 0{0,)-convex, and if d^l = K U M, where M is a connected 
hypersurface ofC^\K, then K is CR-removable. 

Example 3.14. ( ||CStl994[[Jol999aD Let M be a connected compact orientable 
(2n — 3) -dimensional maximally complex (Definition 4.7 below) CR manifold 
of class contained in the unit sphere c)B„ (re ^ 2) with empty boundary in 
the sense of currents. Such an M is called a maximally complex cycle. By a 
theorem due to Harvey-Lawson (reviewed as Theorem 4.16 below), if M sat- 
isfies the moments' condition, then M is the boundary of a unique complex 
(re — 1) -dimensional complex subvariety S C ]B„. Since the cohomology group 
i/^(B„, Z) vanishes, by a standard Cousin problem, S may be defined as the zero- 
set of some global holomorphic function / G 0{Mn) H C*'(B„). The maximum 
principle yields that the compact set A' := S U A/ = S is ^^^(Bn) -convex. Conse- 
quently, the envelope of holomorphy of an arbitrarily thin one-sided neighborhood 
of 9B„\M is equal to the pseudoconvex domain B„\ (M U S) . 

If in addition is Runge ( ||Hol973ll ) or if is polynomially convex, then every 
/ G 0(17) may be approximated uniformly by polynomials on some sufficiently 
small neighborhood of Q. (whose size depends on /). It then follows that polyno- 
mial convexity and 0(17) -convexity are equivalent. As a paradigmatic example, 
this holds when = B^ is the unit ball. 

Corollary 3.15. ( ||Stul993i ) Let Q. and K C be as in Theorem 3. 13 and assume 
that O is Runge in C"", for instance 17 = B„. If K is polynomially convex, then 
K is CR-removable. If n = 2, the CR- removability of K is equivalent to its 
polynomial convexity. 

Although the last necessary and sufficient condition seems to be satisfactory, 
we must point out that concrete geometric characterizations of polynomial con- 
vexity usually are hard to provide. In §5.14 below, we shall describe a class of 
removable compact sets whose polynomial convexity may be established directly. 

A compact subset K of M" {n ^ 1) is a Cantor set if it is perfect, viz. coincides 
with its first derived set K' . It is called tame if there is a homeomorphism of M" 
onto itself that carries K onto the standard middle-third Cantor set contained in 
the coordinate line M^.^. 

Tame Cantor sets K in a strongly pseudoconvex boundary dO. ^ were 
shown to be CR-removable in ||FS1991i . provided there exists a Stein neighbor- 
hood V of K in such that K is 0(P) -convex. By further analysis, this last 
assumption was shown later to be redundant and in general, tame Cantor sets are 
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CR-removable. It was then suggested in IIStul993ll that all Cantor subsets of dMn 
(n ^ 2) are removable, or equivalently polynomially convex. Nevertheless, Rudin 
and then Vitushkin, Henkin and others had constructed Cantor sets K C C'^ hav- 
ing large polynomial hull K, e.g. so that K contains a complex curve, or even 
contains interior points. Recently, in a beautiful paper, Joricke showed how to put 
such sets in the 3-sphere 3B2, thus solving the question in the negative. 

Theorem 3.16. ( lUolOOSID For every positive number r < 1, there exists a Cantor 
set K C whose polynomial hull K contains the closed ball r 182. 

3.17. LP -removability and further results. In the definition of CR-removability, 
nothing is assumed about the behavior from Q\K up to K: the rate of growth 
may be ai^bitraiily high. If, differently, functions ai^e assumed to be tame on 
(including K), better removability assertions hold. 

Definition 3.18. A compact subset A' of a boundary dU, (s C" (n ^ 2) is 
called -removable (1 ^ p ^ 00) if every function / G LP(9$7) which is CR on 
dQ\K is in fact CR on the whole boundary dO.. 

Then by the Hartogs-Bochner theorem, / admits a holomorphic extension to Q. 
that may be checked to belong to H'^{Q). 

Theorem 3.19. ( MAC 19941 ) Let n C'"- {n ^ 2) be a bounded domain having 
boundary dQ and let M be a totally real embedded submanifold of d^. If 
K C Ad is a polynomially convex compact subset, then K is -removable. 

In complex dimension n ^ 3, the two extension Theorems 3.13 and 3.19 are 
not optimal. In general, additional extension phenomena occur, which are princi- 
pally overlooked by assumptions on the hull of the singularity. A more geometric 
point of view (§3.23 below) shows that these theorems may be established by 
means of holomoiphic extension along one-parameter families of complex ana- 
lytic hypersurfaces, whereas the (finer) Kontinuitatssatz holds along families of 
analytic discs, whose thinness offers more freedom to fill in maximal domains of 
extension. 

Example 3.20. LetQ := M3 be the unit ball in C'^, and let 

K={{zi,Z2,0) G 5B3 : \zi\ ^ 1/2} 

be a 3-dimensional ring in the intersection of 5B3 with the (zi, Z2)-plane. The 
maximum principle along discs parallel to the 2;2-axis yields: 

^0(B3) = {(^1,^2,0) G B3 : \zi\ ^ 1/2} + K, 

so K is not ^^(Ba) -convex. Nevertheless, this K is removable. Indeed, applying 
the continuity principle, we may first fill in 'Bs\K by means of discs parallel to 
the Z2-axis and then fill in the complete ball B3, by means of discs parallel to the 
Z3-axis. 
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In higher dimensions n ^ 3, the relevant characterizations of CR-removable 
compact sets contained in strongly pseudoconvex frontiers are of cohomological 
nature (§3.33 below). In another vein, the assumption that possesses a Stein 
neighborhood basis in Theorem 3.13 above inspired some authors to generalize 
Stout's theorem as follows. 

Definition 3.21. Let be a relatively compact domain of a Stein manifold A4 
and let C ^2 be a compact set. The 0{M) -convex hull of K is 

^^o(M) ■■= \ z e M : \g{z)\ ^ max \g{w)\ for all 5 G 0{M)\. 

If K = KQf^j^y then K is called 0{M)-convex. 

In C", the ©(TW) -convex hull coincides with the polynomial hull. Notice that 
the next theorem is valid without pseudoconvexity assumption on Q.. 



Theorem 3.22. ( IIStul981[lLtT988l|Kyl991ilStul9931IJol995l ) Let Mbea Stein 



manifold of dimension n ^ 2, let Q, Ai be a relatively compact domain such 
that is connected and let K C VL be a compact set with K = Kqi^j^-^ D 

dil. Then every CR function f defined on dO,\K extends holomorphically to 

^\Ko{M)' i-^ ' 

• if dQ\K is a C^'" hypersurface, with k ^ 1 and ^ a ^ 1, and if f € 
C'^''^{dO,\K), then the holomorphic extension F E 0{Q\K) belongs to 

the class C'''°'{Ti\Ko(M))' 

• ;/ di^\K is a hypersurface and if f £ L'^^^{dQ\K) with 1 ^ 
p ^ 00, then at every point p G dO,\K, the holomorphic extension 
F G C'(r2\i^0(_A4)) belongs to the Hardy space H'^^^jUp H Q),for some 
small neighborhood Up ofp in M. 

3.23. ^(O)-hull and removal of singularities on pseudoconvex boundaries. 

Following II Jo 1 995 [ [Po 1 997 [ |jP2002 1 . we now expose a geometric aspect of some 
of the preceding removability theorems. Let Q d C" with n ^ 2 be a bounded 
domain having frontier of class at least C^. By A{il.) = 0(17) n ^(0), we denote 
the ring of holomorphic functions in Q, that are continuous up to the boundary 
Let /y C 17 be a compact set. 

Definition 3.24. The ^(O)-hull of K is 

KA(n) ■■= \ z en-. \g{z)\ ^ max \g{w)\ for all g G A{Q)]. 

If K = i^^(n), then K is called 71(17) -convex. If K = D -ftrA(n)' then K is 
called CR-convex. 



The next theorem is sti^onger than Theorem 3.13 in two aspects: 
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• the inclusion /^^(f^) C K^^j^^ holds in general and may be strict; 

• it is not assumed that the pseudoconvex domain Q has a Stein neighbor- 
hood basis. 

Theorem 3.25. ( IIJol995ll ) Let Q be a bounded weakly pseudoconvex domain in 
having frontier of class and let K be a compact subset ofdCl with K ^ dQ 
such that K is CR-convex, namely K = OOn-ftTy^j-Q). Then the following are true. 

1) Let V{dQ\K) be an interior one-sided neighborhood of dVt\K with the 
property that each connected component of V{dVL\K) contains in its 
boundary exactly one component ofdO,\K and no other point ofdQ\K. 
Then for every holomorphic function f £ 0(y{d^l\K)y there exists a 

holomorphic function F G 0{VL\Ka^q;^) with F = f in V{d^}\K). 

2) ( MAS 199011 ) There is a one-to-one correspondence between connected 
components of dQ\K and connected components of i}\Kj^(^Qy namely 
the boundary of each component of Q\K contains exactly one con- 
nected component ofdVl\K and does not intersect any other component. 

3) If the boundary dVl is of class C°°, then r2\K^(Q) is pseudoconvex, hence 
it is the envelope of holomorphy ofV{dQ\K). 

If K is not CR-convex, the one-to-one con^espondence between the connected 
components of dQ\K and those of dQ\K^(^Q-^ may fail. 

Example 3.26. Indeed, let := 1B2 n {xi < be a truncation of the unit ball 
and let := dM2 H {xi = ^} be the intersection of the three-sphere 5B2 with 
the real hyperplane {xi = ^ } {see only the left hand side of the diagram). 



r2 ^ 




r2 ^ ^ 














' - K' 


Q 








n' 










5^1^ 

















Relevance of the assumption of CR-convexity 



The Levi-flat 3-ball IB2 n {xi = ^} being foliated by complex discs, the maxi- 
mum principle entails that A'^(q) = ]B2n{xi = ^} = -f^A(c)i^f^^ 7^ hence i^T 
is not CR-convex. Also, dfi\K has two connected components dM2 n {xi < i| 
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and B2 n {xi = whereas = 8^2 n {xi < ^} is connected. Any 

function on dQ\K equal to two distinct constants on the two connected compo- 
nents of d^\K is CR and not holomorphically extendable to = 0\Er^(Q). 
Finally, by smoothing out dO. near the two-sphere n{a;i = 5}, we obtain an 
example with C°° boundary. 

3.27. Hulls and holomorphic extension from nonpseudoconvex boundaries. 

Since the work ||Lul986ll of Lupacciolu, the extension of Theorem 3.7 to nonpseu- 
doconvex boundaries was a daring open problem ( ||Stul993ll ). 

Theorem 3.28. ( IIPol9971 IJP20021 ILP2003D Let n be a not necessarily pseu- 
doconvex bounded domain in C" (n ^ 2) having connected frontier and let 
K C be a compact set with dQ\K connected such that K = dVl n Kj^^Q^y 
Then for every continuous CR function f G C(^j^{dQ,\K), there exists a holo- 
morphic function F G 0{p.\Kj^^fi)) n U [dU\K]) such that 
P\dn\K = /• 

A purely geometrical proof applying a global continuity principle together 
with a fine control of monodromy may be found in ||Pol997[ I JP2002II : cf. 
also IIMP2007I . By a topological device, a second proof ( IILP2003II ) derives the 
theorem from the following statement, established by means of d techniques. 

Theorem 3.29. ( l|Ltl988ll ) Let Mbe a Stein manifold of complex dimension n ^ 
2, let K C Ai be a compact set that is 0{M.) -convex and let Q C M. be a 
relatively compact not necessarily pseudoconvex domain such that dQ\K is a 
connected hypersurface of M\K. Then for every continuous CR function f 
on dil.\K, there exists a holomorphic function F S 0{il\K) n C^{i^\K) with 
F\dn\K = /• 

Contrary to the case where dQ is pseudoconvex (as in Theorem 3.25), even if K 
is CR-convex, the one-to-one correspondence between the connected components 
of dQ,\K and those of may fail to hold. For this reason, d^\K is 

assumed to be connected in Theorem 3.29. 

Example 3.30. ( IILP2003II ) We modify Example 3.26 so as to get a nonpseu- 
doconvex boundary as follows {see the right hand side of the diagram above). 
Let Q,' be the unit ball B2 from which we substract the closed ball B{q, 1) of 
radius 1 centered at the point q of coordinates (1,0). A computation with defin- 
ing (in)equations shows that Q' is contained in |xi < ^j. Notice that 0' is 
not pseudoconvex and in fact, its envelope of holomorphy is single-sheeted and 
equal to the domain Q = M2 D {xi < ■^^ drawn in the left hand side. Let 
K' := B2 n {xi = i} C dfl' (this set is the same 2-sphere as the set K of the 
preceding example). Then K' is CR-convex, since the candidate for its A{Q')- 
hull is the three-sphere B2 H {xi = ^} that lies outside Q'. However, dQ'\K' has 
two connected components, namely dM2 H {xi < ^} and dB{q, 1) n {xi < 
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whereas Q,'\K'^^^,^ = Q'\K' = Q' is connected. Hence any CR function equal to 
two distinct constants on these two components fails to extend holomorphically 
to 0'. Finally, by smoothing out 50 near the two-sphere dM2 n{xi = ^},we 
obtain an example with boundary. 

If we drop CR-convexity of K, viz. if K ^A(r2) ^ dQ, then monodromy 
problems come on scene: the natural embedding of into the envelope of 

holomorphy of a one-sided neighborhood of dQ,\K may fail to be one-to-one. 

Example 3.31. ( IILP2003II ) Consider the real four-dimensional open cube C := 

(-1, 1) X i (-1, 1) X (-1, 1) X 1) in ~ M''. 




Choose e > small and remove from this cube C firstly the narrow tunnel 
'^1 '■= {1-22 1 ^ e, \xi — 1/2| ^ e} having an entrance and an exit and secondly 
the (incomplete) narrow tunnel T2 := {\z2\ ^ e, |xi + 1/2| ^ e, — 1 < yi ^ 
1/2} having only an entrance, and call O the obtained domain. Let K := dC n 
{yi = 0}- The complete tunnel insures that dQ\K is connected. Moreover, the 
maximum principle along families of analytic discs parallel to the complex 2;2-axis 
enables to verify that 

KAin) = {^n {yi = 0}) U ^' U {dTi D {yi = 0}) |J {8% D {yi = 0}) . 

It follows that dQ\Ky^(^Q^ has three connected components, firstly the part Ti of 
(90 that lies in the half-space {yi < 0}; secondly the dead-lock part T2 of the 
second tunnel that lies in {yi > 0}; and thirdly, the remainder T3 of the boundary, 
that lies in {yi > 0}. 

The branch of log zi satisfying log 1 = is uniquely defined in C^\{(xi, Z2) 
Xl ^ 0}, hence log zi is holomorphic in a neighborhood of dQ\T2, where 
T2 := 8X2 n {yi ^ 0}. In addition, logzi extends from points near T2 in 
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{yi < 0} to a neighborhood of T2. In sum, it defines a single- valued function 
that is holomorphic in a neighborhood of dQ. 

Observe that ( - ^ + §, O) e T2 C dil.. The value of log zi thus defined at this 
point is log(-^ e-*57r/4^ _ _ ^ ^ j-j^g other hand, log zi restricted to a 

neighborhood of dC H {yi > 0} C dU extends holomorphically to C n {yi > 0} 
(by means of unit discs parallel to the Z2-axis) as log zi itself! But the value of 
this extension at ( - i + 1, O) is different: log(-^ e*^''/^) =log^ + i^. 

To conclude this paragraph, before surveying the cohomological characteriza- 
tions of removable singularities in dimension n ^ 3, we reformulate the obtained 
characterization in complex dimension n = 2. It is known that a compact set 
iiT C C" is polynomially convex if and only if the 5-cohomology group H^'^{K) 
is trivial and holomorphic functions in a neighborhood of K can be approximated 
by polynomials uniformly on K. Thus, we can state a complete formulation of 
Theorem 3.7, with the supplementary assumption that 0(^1) may be approximated 
uniformly by polynomials. This insures that polynomial convexity coincides with 
0(17) -convexity. As a major example, the theorem holds for equal to the unit 
ballBa (Corollary 3.15). 

Theorem 3.32. ( IIStul989[ IStuT993l ILul994[ ICStl994ll ') The following four con- 
ditions for a compact subset K of a strongly pseudoconvex compact boundary 
(E with Q. Runge or polynomially convex are equivalent: 

• K is 0{0,)-convex. 

• K is polynomially convex. 

• H^'^{K) = and holomorphic functions in a neighborhood ofK can be 
approximated by polynomials uniformly on K 

• K is removable. 

Thus, in this situation, removability amounts to polynomial convexity. Nev- 
ertheless, the problem of characterizing geometrically the polynomial convexity 
of compact sets hides several fine questions. We shall come back to this topic in 
Section 5. 

3.33. Luppaciolu's characterizations. An outstanding theorem due to Lupacci- 
olu provides complete cohomological characterizations of removable sets that are 
contained in strongly pseudoconvex boundaries, for general n ^ 2. 

Let be a Stein manifold of dimension n ^ 2 and let d be a relatively 
compact strongly pseudoconvex domain having boundary. 

Let H^'^ := Z^'^ / 88^'''"^ denote the usual (p, g)-th Dolbeault cohomology 

groupPI. We endow the space Z^'^~'^{K) of 9-closed (n,n — 2)-forms defined 



Appropriate background, further survey of Lupacciolu's results and additional ma- 
terial may be found in ||CStl994| . 
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in a neighborhood of a compact set K C A4 with the standard locally convex in- 
ductive limit topology derived from the inductive system of the Frechet-Schwartz 
spaces as U ranges through a fundamental system of open neighbor- 

hoods of K inM. 

Theorem 3.34. ( ||Lul9941ICStl994|| ) Assume that 9. is 0{M)-convex. A proper 
closed subset K of dQ is removable if and only if H^'^~^ (K) = and the re- 
striction map Z^'"^'^{M) —>■ Z^'^~'^{K) has dense image. 

For n = 2, the two conditions of the theorem reduce to the C'(Al) -convexity 
of K ( IILul994[|CStl994ll ). For n ^ 3, the following improvement is vahd. By 
'^E, we denote the separated space associated to a given topological vector space 
E, namely the quotient £^/0 of £" by the closure of 0. 

Theorem 3.35. ( ||Lul994[rCStl994|| ) Assume that n ^ 3. Without the assumption 
that 0, is 0{M) -convex, the compact set K C is removable if and only if 

H^'''-\k) =Oand^H^'"-\K) = 0. 

Lupacciolu also obtains an extrinsic characterization as follows. Let $ be the 
paracompactifying family of all closed subsets of A4\K that have compact clo- 
sure in M. Let H^'^ the Dolbeault cohomology groups with support in <I>. 

Theorem 3.36. ( IILul994[ ICStl994ll ) For n ^ 3, a compact subset K of the 
boundary dil of a C^-bounded strongly pseudoconvex domain Vt ^ Ai is remov- 
able if and only if H^'^{M\K) = 0. 

Notice that, for n ^ 3, this theorem has the striking consequence that the con- 
dition that K be removable in a strongly pseudoconvex boundary does not depend 
on the domain in question, but rather on the situation of K itself in the ambi- 
ent manifold. Also, Lupacciolu provides analogous characterizations for weak 
removability ( IILul994llCStT994ll ). 

§4. Smooth and metrically thin removable singularities 
for cr functions 

4.1. Three notions of removability. We formulate the concerned notions of re- 
movability directly in arbitrary codimension. Let M C C" be a C^'" generic sub- 
manifold of positive codimension d ^ I and of positive CR dimension m ^ 1. 
Such M will always be supposed connected. In the sequel, not to mention super- 
ficial corollaries, we will systematically assume that M is globally minimal. 

Definition 4.2. ( IIMel997[ IMP19981 IJol999a[ IJdl999bl IMP19991 IMP2002II ) A 
closed subset C of M is said to be: 

• CR-removable if there exists a wedgelike domain W attached to M to 
which every continuous CR function / G Cqpi{M\C) extends holomor- 
phically; 
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• yV-removable if for every wedgelike domain Wi attached to M\C, there 
is a wedgelike domain W2 attached to M and a wedgelike domain W3 C 
Wi n attached to M\C such that for every holomorphic function 
/ G 0{Wi), there exists a holomorphic function F G C'(yV2) which 
coincides with / in W3; 

• L'^ -removable, where 1 ^ p ^ 00, if every locally integrable function 
/ G L['^^(Af ) which is CR in the distributional sense on M\C is in fact 
CR on all of M. 

A few comments are welcome. CR-removability requires at least M\C to 
be globally minimal, in order that the main Theorem 4. 12(V) applies, yielding 
a wedgelike domain Wi attached to M\C. Then W-removability of C implies 
its CR-removability. In both CR- and W-removabililty, after the removal of C, 
nothing is demanded about the growth of the holomorphic extension to a global 
wedgelike domain W2 attached to M. Such extensions might well have essential 
singularities at some points of C, although they are holomorphic in W2- On the 
contrary, for LP -removability of C, CR functions on M\C should really extend 
to be CR through C. 

Notwithstanding this difference, the sequel will reveal that LP -removability is 
also a consequence of W-removability, thanks to some Hardy-space control of 
the holomorphic extension F G 0{W2)- In fact, functions are assumed to be 
^^oc variant is to assume continuity on M instead of integrability) even neai^ 
points of C. This strong assumption enables to get a control of the growth of the 
wedge extension. Before providing more explanations, we assert in advance that 
W-removability is the most general notion of removability, focusing the question 
on envelopes of holomoiphy. 

In codimension d = 1, wedgelike domains identify to one-sided neighbor- 
hoods. Then W-removability of C means that the envelope of holomorphy of 
every (arbitrarily thin) one-sided neighborhood of M\C contains a complete one- 
sided neighborhood of the hypersurface M in C". If M = dQ is the boundary of 
a bounded domain Q C C" (having connected boundary), then W-removability 
of a compact set K C dQ entails its removability in the sense of Problem 3.2, 
thanks to Hartogs Theorem 1.8(V). 

As in IIJo 1 999b [ IMP 1 9991 . we would Uke to emphasize that all the general the- 
orems presented in Sections 3 and 4 are void for Lj^^ functions, or require a strong 
assumption of growth. On the contrary, the results that will be presented below 
hold in all spaces Lf^^ with 1 ^ p ^ cxd, without any assumption of growth. The 
concept of W-removability, interpreted as a result about envelopes of holomorphy, 
yields a (crucial) external drawing near the illusory singularity, an opportunity that 
is intrinsically attached to locally embeddable Cauchy-Riemann structures, but is 
of course absent for general linear partial differential operators. 
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4.3. Removable singularities on hypersurfaces. In MLS 199311 . it is shown that 
if C C" is a pseudoconvex bounded domain having boundary, then every 
compact subset K C dQ with H'^"'~^{K) = is removable in the sense of Def- 
inition 3.4. In fact, Lemma 4.18(111) shows that dfl is globally minimal and the 
next lemma shows that in codimension d = 1, metrically thin singularities do not 
perturb global minimality. 

Lemma 4.4. ( IIMP2002II ) IfM C C"- is a globally minimal hypersurface, then 
for every closed set C C M with H^"~'^(C) = 0, the complement M\C is also 
globally minimal. 

Example 4.5. However, this is untrue if H^'^~'^(C) > 0. Let n 2 and Lp{z, u) 
be defined for |z|, |m| < 1 and satisfying 92(2:, 0) = for Rezi ^ 0. Let 
M C be the graph v = ip{z, u) and define C := {{i yi, Z2, ■ ■ ■ , Zn-i,0)}- 
Clearly dimC = 2n - 3, H2"-3(C) > and {(z,0) :Rezi < 0} is a single 
CR orbit O- of M\C. Also, the function ip may be chosen so that M is of finite 
type at every point of M\0-, whence M\C consists of exactly two CR orbits, 
namely and M\{0- U C). It follows that M is globally minimal. 

Theorem 4.6. ( ULS 19931 ICStT994llMP1998[IMP2002D IfM c C" is a globally 
minimal C^'° (0 < a < 1) hypersurface, then every closed set C C M with 
H2"-3(C) = HdimM-2(^(j^ ^ q j^^^Uy and -removable. 

Sometimes, we shall say that C is of codimension 2''''^ in M. This is a version 
of (rml) and of (rm2) of Theorem 2.30 for CR functions on general hypersur- 
faces. Except for -removability, refinements about smoothness assumptions 
may be found in IICStl994ll . 

The smallest (Hausdorff) dimension of C C M C C" for which its removabil- 
ity may fail is equal to 2n — 3. Indeed, if C = M n S is equal to the intersection 
of M with some local complex hypersurface S = {/ = 0}, the functions 1/ f^, 
k ^ 1 and e^/ ^ restrict to be CR on M\C, but not holomorphically extendable 
to a one-sided neighborhood at points of C, since S visits both sides of M. In 
such a situation, the real hypersurface A/ n S of the complex hypersurface S has 
dimension (2n — 3) and CR dimension (n — 2). 

Definition 4.7. A CR submanifold iV C C" is called maximally complex if it is 
of odd dimension satisfying dim = 1 + 2 CRdim A^. 

Every real hypersurface of a complex manifold is maximally complex. The 
next step in to study singularities C contained in (2n — 3) -dimensional submani- 
folds N CM. 

Example 4.8. We show the necessity of assuming that M\C is also globally min- 
imal ( UMP 199911 ). Take the complex hypersurface 0_ of the preceding example 
having boundary dO^ = C = N. Applying Proposition 4.38(111) to S := 0-, 
we may construct a measure on M\C supported by that is CR on M\C but 
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does not extend holomorphically to a wedge at any point of O- = O- U C, for 
the same reason as in Corollary 4.39(111). 

Because of this example, we shall systematically assume that M\C is also 
globally minimal, if this is not a consequence of other hypotheses. Here is a CR 
version of (rm3) and of (rm4) of Theorem 2.30. It says that true singularities 
should be maximally complex. Before stating it, we point out that all subman- 
ifolds of given manifolds will constantly be assumed to be embedded subman- 
ifolds. Also, all subsets C of a submanifold of manifold M that are called 
closed are assumed to be closed both in M and in N. 

Theorem 4.9, ( IIJol9921 IMel997[ IJol999al IJol999bD Let M c be a C^-" 

(0 < a < 1) globally minimal hypersurface and let N C M be a connected 
C^'" embedded submanifold of dimension {2n — 3), viz- of codimension 2 in M. 
A closed set C C N such that M\C is also globally minimal is CR-, W- and 
-removable under each one of the following two circumstances'. 

(i) n ^ 2 and C ^ N; 

(ii) n ^ 3 and C = N is not maximally complex, viz- there exists at least one 
point p ^ N at which N is generic- 

One may verify ( IIJol999a[ IMP 19991 ) that generic points of N are locally re- 
movable and then after erasing them by deforming slightly M inside the exten- 
sional wedge existing above, (ii) is seen to be a consequence of (i). For vari- 
ous smoothness refinements, the reader is referred to IIJ619921ICStl994[|MP1998[ 
IJol999al lJ5T999bl lMPT999ll . One may also combine Theorem 4.6 and 4.9, as- 
suming that the submanifold is smooth, except perhaps at all points of some 
metrically thin closed subset. The proof will not be restituted. 

The study of more massive singularities contained in {2n — 2) -dimensional 
submanifolds has been initiated by Joricke ( IIJol988l ). having in mind some gen- 
eralization of Denjoy's approach to Painleve's problem. 

Theorem 4.10. ( IIJol999a[ IJol999bD Let M c be a C^'" (0 < a < 1) 
globally minimal hypersurface and let d M be a connected C^'" embedded 
submanifold^ of dimension (2n — 2), viz- of codimension 1 in M, that is generic 
in C". If n ^ 3, a closed set C C is CR-, W- and -removable provided it 
does not contain any CR orbit of M^- 

It may be estabhshed [see e-g- Lemma 3.3 in IIMP2006all ) that M^\C' is also 
globally minimal for every closed C C containing no CR orbit of M^. 



We believe that C^'"-smoothness of A/^ is required in the proof built there, since the 
map w h{w) appearing in equation (3.12) of ||Jol999a| (that corresponds essentially 
to the singular integral J^{v) defined in (3.20)(V)) already requires to be C^ " with 
< a < 1 to exist; then to compute the differential of w i-^ h{w), one must require 
to be at least C^'". 
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We would like to mention that the removability of two-codimensional singu- 
larities (Theorem 4.9) is not a consequence of the removability of the bigger one- 
codimensional singularities (Theorem 4.10). Indeed, it may happen that TpN 
contains T^M at several points p ^ N in Theorem 4.9, preventing the existence 
of a generic C M containing N . In addition, even if TpN 7$ T^M for every 
p € N, Theorem 4.9 is not anymore a corollary of Theorem 4.10. Indeed, with 
m = 2 and d = 1, choosing a local hypersurface M C containing a complex 
curve S, choosing N C M of dimension 3 containing S and being maximally 
real outside S, and choosing an arbitrary generic C M containing N (some 
explicit local defining equations may easily be written), then S is a CR orbit of 
M^, so D S is not considered to be removable by Theorem 4.10, whereas 
Theorem 4.9(ii) asserts that N is removable. 

Although singularities are more massive in Theorem 4. 10, the assumption n ^ 
3 in it entails that the CR dimension (n — 1) of M is ^ 2, whence has 
positive CR dimension ^ 1. This insures the existence of small analytic discs 
with boundary in M^. Section 5 below and IIMP2006all as a whole are devoted to 
the more delicate case where has null CR dimension. 

Example 4.11. ( IIJol999all ) In C^, let M = dMs and let := {(^1,22,^3) : 

< Xl < 1/2, yi = 0}. Clearly, is foUated by the 3-spheres 

:= {zi = xl, \Z2\^ + |Z3P = 1 - 

xl S (0, 1/2), that are globally minimal compact 3-dimensional strongly pseu- 
doconvex maximally complex CR submanifolds of CR dimension 1 bounding the 
2-dimensional complex balls 

^2,xl ■■= {zi = xl, \Z2\'^ + |Z3P < 1 - 

Theorem 4.10 asserts that a compact set K C is removable if and only if it 
does not contain a whole sphere Sx^, for some xl G (0, 1/2). If K contains such 
a sphere 5^,, the complex 2-ball M2^xi coincides with the A(r2)-hull of 5^:* and 
is nonremovable. More generally, an application of both Theorems 4.10 and 3.25 
yields the following. 

Corollary 4.12. Let K be a compact subset of M^. For every {interior) 
one-sided neighborhood V~ (5B3\i(') that is contained in B3 and every func- 
tion f holomorphic in V~(5]B3\i^), there exists a function F holomorphic in 

^A^x*- 53 cx ^2,xi With F = fin V"{dMs\K). 

By means of the complex Plateau problem, the next paragraph discusses the 
necessity for N not to be maximally complex in Theorem 4.9 and for not to 
contain any CR orbit in Theorem 4.10, in a more general context than M = 5B„. 
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4.13. Complex Plateau problem and nonremovable singularities contained in 
strongly pseudoconvex boundaries. Let be a complex manifold of dimen- 
sion n ^ 2. If S C is a closed pure fc-dimensional complex subvariety, we 
denote by [S] the cun^ent of integration on S, whose existence was established by 
Lelong in 1957 ( IIChl989[lDeT997.n . 

Definition 4.14. ( IIHL1975[|Hal977ll ) A current T on is called a holomorphic 
k-chain if it is of the form 

finite 

where the Sj denote the irreducible components of a pure fc-dimensional complex 
subvariety S of and where the multiplicity rij of each is an integer. 

The complex Plateau problem consists in filling boundaries N by complex sub- 
varieties S, or more generally by holomorphic chains T. Maximal complexity of 
the boundary N is naturally required and since N might encounter singular points 
of S, it should be allowed in advance to be "scarred" somehow. Also, the bound- 
ary N inherits an orientation from S and as the boundary of S, it should have 
empty boundary. 

Definition 4.15. A scarred C"^ (1 ^ k ^ oo) maximally complex cycle of dimen- 
sion (2m + 1), m ^ 0, is a compact subset N C A4 together with a thin compact 
scar set SCn C N such that 

• H2™+1(scjv) = 0; 

• SCat is an oriented (2?7i+l)-dimensional embedded maximally com- 
plex submanifold of J\A\sCn having finite (2m + 1) -dimensional 
Hausdorff measure; 

• the current of integration over N\sCn, denoted by [N], has no boundary: 

d[N] = 0. 

This definition was essentially devised by Harvey-Lawson and appears to be 
adequately large, but sufficiently stringent to maintain the possibility of filling a 
maximally complex cycle by a complex analytic set. 

Theorem 4.16. ( IIHL1975[|HaT977l ) Suppose N is a scarred (1 ^ k ^ cx)) 
maximally complex cycle of dimension (2m + 1), m ^ 0, in a Stein manifold M. 

• lfm = 0, assume that N satisfies the moment condition, viz- u) = 
for every holomorphic 1-form lo = X]fc=i ^k{z) dz^ having entire coef- 
ficients LOk G ©(C"). 

• If m ^ 1, assume nothing, since the corresponding appropriate moment 
condition follows automatically from the assumption of maximal com- 
plexity ( IIHL1975II ). 
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Then there exists a unique holomorphic [m + l)-chain T in A4\N having 
compact support and finite mass in M such that 

dJ = [N] 

in the sense of currents in Ai. Furthermore, there is a compact subset K ofN with 
H2™+i(i4r) = such that every point of N\{K use n) possesses a neighborhood 
in which (supp T) U is a regular complex manifold with boundary. 

A paradigmatic example, much considered since Milnor studied it, consists in 
intersecting a complex algebraic subvariety of passing through the origin with 
a spere centered at 0; topologists usually require that is an isolated singularity 
and that the sphere is small or that the defining polynomial is homogeneous. 

We apply this filling theorem in a specific situation. Let d C" (n ^ 3) 
be a strongly pseudoconvex boundary and let C 90 be an embedded 
one-codimensional submanifold that is generic in C". We assume that has 
no boundary and is closed, viz. is a compact submanifold. Since has CR 
dimension (n — 2), its CR orbits have dimension equal to either (2n — 4), or to 
(2n - 3) or to (2n - 2). Because of Corollary 4. 19(111), no CR orbit of can be 
an immersed complex 2-codimensional submanifold, of real dimension (2n — 4), 
since its closure in would be a compact set laminated by complex manifolds. 
Nevertheless, there may exist (2n — 3) -dimensional CR orbits. 

Proposition 4.17. ( ||Jdl999all ) Every CR orbit O^j^ of a connected hypersur- 
face A/^ C 90 of a strongly pseudoconvex boundary dO, d C" is of the 
following types: 

(i) is an open subset of M; 

(ii) 0(7^ is a closed maximally complex cycle embedded in M^; 

(iii) 0(7^ is a maximally complex submanifold injectively immersed in 
whose closure C consists of an uncountable union of similar CR orbits. 

In the last situation, C will be called a maximally complex exceptional minimal 
compact CR-invariant set. The intersection of C with a local curve transversal to 
a piece CR orbit in may consist of either an open segment or of a Cantor 
(perfect) subset. 

Here is the desired converse to both Theorems 4.9 and 4. 10 in a situation where 
the Plateau complex filling works. 

Corollary 4.18. ( IIJol999al ) Suppose that 90 G C^'° contains a compact embed- 
ded {2n — 3)-dimensional maximally complex submanifold N (without boundary). 
Then N is not removable. 

Proof. Indeed, the scar set of is empty and the filling of by a holomorphic 
chain consists of an irreducible complex subvariety S that is necessarily contained 
in 0, since 90 is strongly pseudoconvex. Then the domain 0\S is seen to be 
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pseudoconvex and A^yi(f7) = N UT,. Theorem 3.25 entails that CR functions on 
d^\N extend holomoiphicaly to □ 

A very natural problem, raised in ||Jol999all and inspired by a perturbation 
of Example 4. 11, is to determine for which compact CR-invariant subsets K of a 
strongly pseudoconvex boundary dQ C C" the envelope of holomorphy of dQ\K 
is multi-sheeted. 

Theorem 4.19. ( II JS 20041 ) LgfM^ C dB>n be an orientable {2n- 2) -dimensional 
generic C^'" submanifold of 5B„ (n ^ 3) and let K C be a compact CR- 
invariant subset of such that 

• the boundary of K in is the disjoint union of finitely many con- 
nected compact maximally complex CR manifolds Ni, . . . , Ni of dimen- 
sion (2n - 3) that are (jS-a-O cR orbits ofM^; 

• the interior of K with respect to is globally minimal. 

Then the envelope of holomorphy E(V(5B„\i^)) is multi-sheeted in every 
neighborhood Up C B„ of every point p G Int K. 

We conclude these considerations by formulating a deeply open problem raised 
by Joricke. The complex Plateau problem for laminated boundaries is a virgin 
mathematical landscape. 

Open question 4.20. ( IIJ6l999al ) Let d^l d C", n ^ 3, be a strongly pseudocon- 
vex boundary of class at least C^. Suppose that dQ contains a maximally complex 
exceptional minimal compact CR-invariant set C. Does C bound a relatively 
compact subset S C laminated by complex manifolds ? 

As observed in IIDH1997i IMP19981 ISal999i IDS2001L removable singular- 
ities have an unexpected interesting application to wedge extension of CR- 
meromorphic functions. 

4.21. CR-meromorphic functions and metrically thin singularities. For n ^ 

2, a local meromorphic map / from a domain C C" to the Riemann sphere 
Pi(C) has an exceptional locus If C Q., at every point p of which the value 
f{p) is undefined. For instance the origin (0, 0) G with / = ^ (notice that 
every complex number in C U {oo} is a limit of This exceptional set If is a 
complex analytic subset of Q. having codimension ^ 2 ( ||Del997|| ). It is called the 
indeterminacy set of f. 

A meromorphic function may be more conveniently defined as a n-dimensional 
irreducibe complex analytic subset of x Pi (C) having surjective projection 
onto rj, viz. TTQ^Tf) = 17. Here, 17 might be any complex manifold. Indeter- 
minacy points con^espond precisely to points p £ Q satisfying Tr^^{p) DTj = 
{p} X Pi(C). So, the generalization of meromorphy to the CR category incorpo- 
rates indeterminacy points. 
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Definition 4.22. ( IIHL1975I IDH1997[ IMP1998I ISal999ll ') Let M c C" be a 
scarred generic submanifold of codimension d ^ 1 and of CR dimension 
m = n — d ^ 1. Then a CR meromorphic function on M with values in Pi(C) 
consists of a triple (/, Dj, Fj) such that: 

1) Vf C M is a dense open subset of M and / : Vj — > Pi{C) is a map; 

2) the closure in C" x Pi(C) of the graph {(p, /(p)) : p G ^/} defines 
an oriented scarred CR submanifold of C" x Pi(C) of the same CR 
dimension as M having empty boundary in the sense of currents. 

The indeterminacy locus of / is denoted by 

If ■= {peM : {p} X Pi(C) C Tf}. 

In the CR category, If is not as thin as in the holomorphic category (where it has 
real codimension ^ 4), but it is nevertheless thin enough for future puiposes, as 
we shall see. A standard argument from geometric measure theory yields almost 
everywhere smoothness of almost every level set. 

Lemma 4.23. ( IIFel9691IHLT975llHal977l ') Let M cC^bea scarred generic 
submanifold. Let (f,T>f,Tf) be a CR meromorphic function on M. Then for 
almost every w £ Pi (C), the level set 

Nf{w) := {pe M : {p,w) G Tj} 

is a scarred 2-codimensional submanifold of M. 

Let p G If. Since {p,w) G Tj for every w G Pi{C), it follows that If C 
Nf{w) for every lu. Fixing such a w G Pi(C), we simply denote Nf := Nf{w). 
In particular, the scar set SCat^. of Nf is always of codimension 2^^ in M, namely 

HdimM-2(s^^^ ) ^0. 

So If C Nf and by definition If x Pi{C) CTf. We claim that, in addition. If 
has empty interior in Nf\sCj\if Otherwise, there exist a point p G Nf\sCNf and 
a neighborhood Up of p in M with Up n SCat^. = such that If contains Up n Nf, 
whence 

(UpHNf) X Pi(C) C Tf. 

Since {Up H Nf) x -Pi(C) has dimension equal to dimM = dimFj, it follows 
that 

Tf n {Up X Pi(C)) = {Up n Nf) X Pi(C). 

But Up n Nf having codimension two in Up, this contradicts the assumption that 
Fj is a (nonempty!) graph above the dense open subset UpHVf of Up. 

Lemma 4.24. ( ||MP1998[|Sal999i ) The indeterminacy set If of f is a closed set 
of empty interior contained in some 2-codimensional scarred submanifold Nf 
of M. Moreover, the scar set SCn^ of Nf is always of codimension 2'^^ in M, viz. 
H2m+d-2(scjv ) = 0. 
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The statement below and its proof are clear if Vf = M; in it, the condition 
d[Tf] = helps in an essential way to keep it true when the closure of pos- 
sesses a nonempty scar set. 

Proposition 4.25. ( ||MP1998[|Sal999l ) There exists a unique CR measure J f on 
M\If with Tjlx)^ coinciding with the CR function f : Vj ^ Pi(C). 

It is defined locally as follows. Let p G M\If and let Up be an open neigh- 
borhood of p in M. Since p If, there exists Wp £ -Pi(C) with {p, Wp) Tj. 
Composing with an automorphism of Pi{C) and shrinking Up, we may assume 
that Wp = oo and that [Up x {oo}) n F/- = 0. Letting dVolu^ be some {2m + d)- 
dimensional volume form on Up, letting vrr^ : Tj ^ M denote the natural pro- 
jection, the CR measure T f L is defined by 

I Up 

(Tf, w-TT^{ipdYoluj,), 

for every ip G Cl{Up). 

Thus, on M\If, the CR-meromorphic function {f,Vf,Tf) behaves like an 
order zero CR distribution. With C^^, it therefore enjoys the extendabil- 

ity properties of Part V on M\If, provided that M is C^'". The next theorem 
should be applied to C := If. Its final proof ( IIMP2002I ) under the most gen- 
eral assumptions combines both the CR extension theory and the application of 
the Riemann-Hilbert problem to global discs attached to maximally real subman- 
ifolds ( IIG11994llGlT^96l '). We cannot restitute the proof here. 

Theorem 4.26. ( IIMP1998[ IDSIOOTI IMP20021 ) Suppose M c C" is C^'" (0 < 
a < 1) of codimension d ^ 1 and of CR dimension m ^ 1. Then every 
closed subset C of M such that M and M\C are globally minimal and such 
that h2'^+^-2(C) = is CR-, W- and -removable. 

However, if / is a CR-meromorphic function defined on such a M, with 
replaced by C^'" in Definition 4.22, the complement M\If need not be globally 
minimal if M is, and it is easy to construct manifolds M and closed sets C C M 
with H2™~^(C) < oo which perturb global minimality, cf. Example 4.8. It is 
therefore natural to make the additional assumption that M is locally minimal at 
every point. This assumption is the weakest one that insures that M\C is globally 
minimal, for arbitrary closed sets C C M. 

Corollary 4.27. Assume that M G C^'" is locally minimal at every point and let 
f be a CR-meromorphic function. Then If is CR-, W- and -removable. 

Proof. Lemma 4.24 holds with replaced by C^'". It says that If is a closed 
subset with empty interior of some scan^ed C^'" submanifold Nf of M. The re- 
movability of the portion of If that is contained in the regular part of Nf follows 
from Theorem 4.9(i). The removability of the remaining scar set SCnj follows 
from Theorem 4.26 above. □ 
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Thus the CR measure on M\If (Proposition 4.25) extends holomorphically 
to some wedgelike domain Wi attached to M\If. The W-removability of If en- 
tails that the envelope of holomorphy of Wi contains a wedgelike domain W2 
attached to M. Performing supplementary gluing of discs, the CR extension the- 
ory (Part V) insures that such a W2 depends only on M, not on /. As envelopes 
of meromorphy and envelopes of holomorphy of domains in C" coincide by a 
theorem going back to Levi ( IIKS19671IIvl992l ). we may conclude. 

Theorem 4.28. ( IIMP2002II ) Suppose M C C is C^'" and locally minimal at 
every point. Then there exists a wedgelike domain W attached to M to which 
every CR-meromorphic function on M extends meromorphically. 

4.29. Peak and smooth removable singularities in arbitrary codimension. A 

closed set C C M is called a C^'^ peak set, < /? < 1, if there exists a noncon- 
stant function vo G C^'^(M) such that C = {w = 1} and maxpgjv/ 1^(^)1 ^ 1- 

Theorem 4.30. ( IIKR1995llMPT999i ) Let M be C^'" (0 < a < 1) globally mini- 
mal. Then every C^'^ peak set C satisfies H'^'™*^(C) = and is -removable. 

To conclude, we mention two precise generalizations of Theorems 4.9 and 4.10 
to higher codimension. If S = {z : g{z) = 0} is a local complex hypersurface 
passing thi^ough a point p of a generic submanifold M C C" that is transverse to 
M at p, viz. TpE + TpM = TpC, the intersection S n M is a two-codimensional 
submanifold of M that is nowhere generic in a neighborhood of p and certainly 
not (locally) removable, since the CR function ^^|jv/\(EnA/) ^'^^ extendable to 
any local wedge at p. 

Theorem 4.31. ( IIMe 1997 1 IMP 19991 ) Let M C be a " (0 < a < 1) glob- 
ally minimal generic submanifold of positive codimension d ^ I and of positive 
CR dimension m = n — d ^ 1. Let N G M be a connected two-codimensional 
C^'" submanifold and assume that M\N is also globally minimal. A closed set 
C C N is CR-, W- and -removable under each one of the following two cir- 
cumstances: 

(i) m ^ 1 and C ^ N; 

(ii) m ^ 2 and there exists at least one point p £ N at which N is generic. 

In (ii), the assumption that m ^ 2 is essential. Generally, if m = 1, whence 
d = n — 1 and dimM = n + 1, a local transverse intersection C = E n M 
has dimension n — 1, hence cannot be generic, and is not (locally) removable by 
construction. In the next statement, the similar assumption that m ^ 2 is strongly 
used in the proof: the one-codimensional submanifold C M has then CR 
dimension m — 1 ^ 1, hence there exist small Bishop discs attached to M^. 

Theorem 4.32. ( IIPol997[|MeT997llPo2000l ) Let M cC^bea C^-" (0 < a < 1) 
globally minimal generic submanifold of positive codimension d ^ 1. Assume that 
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the CR dimension m = n — dof M satisfies m ^ 2. Let M C M be a connected 
C^'" one-codimensional submanifold that is generic in C". A closed set C C 
is CR-, W- and -removable provided it does not contain any CR orbit of M^. 

Three geometrically different proofs of this theorem will be restituted in Sec- 
tion 10 of IIMP200 6ai The next Section 5 and IIMP2006all are devoted to the 
study of the more delicate case where m = I and where C is contained in some 
one-codimensional submanifold C M. 

§5. Removable singularities in CR dimension 1 

5.1. Removability of totally real discs in strongly pseudoconvex boundaries. 

In 1988, applying a global version of the Kontinuitatssatz, Joricke l|Jol988il es- 
tablished a remarkable theorem, opening the way to a purely geometric study of 
removable singularities. 

Theorem 5.2. ( IIJol988ll ) Let dQ C"^ be a strongly pseudoconvex boundary 
and let D C 30 be a one-codimensional submanifold that is diffeomorphic to 
the unit open 2-disc ofM? and maximally real at every point. Then every compact 
subset K of D is CR-, L°° and W -removable. 

By maximal reality of D, the line distribution D B p £p := TpD n T^M is 
nowhere vanishing and may be integrated. This yields the characteristic foliation 
jT^j on D. The compact set K is contained in a slightly smaller disc D' ^ D hav- 
ing boundary dD'. Poincare-Bendixson's theorem on such a disc D' together 
with the inexistence of singularities of JP"^ entail that every characteristic curve 
that enters into D' must exit from D'. Orienting then the real 2-disc D and its 
characteristic foliation, we have the following topological observation (at the very 
core of the theorem) saying that there always exists a characteristic leaf that is not 
crossed by the removable compact set. 




HOLOMORPHIC EXTENSIONS AND REMOVABLE SINGULARITIES 



253 



J^'^{K} : For every compact subset K' C K, there exists a Jordan curve 7 : 
[—1,1] — > D, whose range is contained in a single leaf of the charac- 
teristic foliation T'f), with 7(— 1) K' , 7(0) G K' and 7(1) K' , such 
that K' lies completely in one closed side o/7[— 1, 1] with respect to the 
topology of D in a neighborhood o/7[— 1, 1]. 

In the more general context of IIMP2006all . we will argue that J^'f^{K} is the 
very reason why K is removable. We will then remove locally a well chosen 
special point p'^^ G ET' n 7[— 1, 1]. In fact, we shall establish removability of 
compact subsets K of general surfaces S that are not necessarily diffeomorphic 
to the unit 2-disc, provided that an analogous topological condition holds. Also, 
getting rid of strong pseudoconvexity, we shall work with a globally minimal C^'" 
hypersurface of C^. Finally, we shall relax slightly the assumption of total reality, 
admitting some complex tangencies. 

Example 5.3. Let Q. = ^2 and let P{z) G C[z] be a homogeneous polynomial of 
degree ^ 2 having has its only singularity. The intersection K := 8^2 H {P = 
0} is a finite union of closed real algebraic curves ~ 5^ that are everywhere 
transverse to T'^dE>2. We may enlarge each curve of K as a thin annulus. 
There is much freedom, but every such annulus is necessarily totally real. Denote 
by S the union of all annuli, a surface in 8^2- Clearly, no component of K is 
removable. But the theorem does not apply: on each annulus, the characteristic 
foliation is radial and K crosses each characteristic leaf. 

Example 5.4. The theorem may fail with the disc D replaced by a surface S 
having nontrivial fundamental group, even with S compact without boundary. 
For instance, in dB>2 = {l^iP + \z2\'^ = 1}, the two-dimensional torus T2 := 
{ (-1= e*^i, e'^'') : 6*1, 02 G M} is compact and K := T2 is not removable, 
since dM2\T2 has exactly two connected components. 

Example 5.5. ( ||Jol988l ) In the same torus T2, consider instead the proper com- 
pact subset K := {{^e'^\ 71^*^') • l^il ^ ^2 G K}, diffeomorphic to 
a closed annulus. It is a set fibered by circles (contained in C^j) over the curve 
7 := {"^6*^1 : 1^1 1 ^ ^} that is contained in C^^. One may verify that the 
condition J^j^^ {K} insuring removability does not hold. In fact, applying The- 
orem 2.2 (in the much simpler version due to Denjoy where the curve is real 
analytic), the curve 7 is not (3, L°°) -removable in C^^. So we may pick a holo- 
morphic function f{zi) G 0{C\j) that is bounded in C U {00} but does not 
extend holomoiphically thi^ough 7. The restriction f]Q^^\^j^ belongs to L°°{dM2), 
is CR on dM2\K but does not extend holomorphically to 182. 

Before pursuing, we compare Theorem 5.2 and Theorem 4.10. 
In codimension ^ 2 (e.g. for curves in M^), no satisfactory generalization of 
the Poincare-Bendixson theory is known and perhaps is out of reach. This gap is 
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caused by the complexity of the topology of phase diagrams, by the freedom that 
curves have to wind wildly around limit cycles, and by the intricate structure of 
singular points. 

Nevertheless, in higher complex dimension n ^ 3, CR orbits are thicker than 
curves and often of codimension ^ 1. For triples (M, , C) as in Theorem 4. 10 
with M = (90 being strongly pseudoconvex, one could expect that a statement 
analogous to Theorem 5.2 holds true, in which the assumption that has simple 
topology would imply automatic removability of every compact subset K C M^. 

To be precise, let (s C" {n ^ 3) be a C^'" strongly pseudoconvex boundary 
and let C 517 be a C^'" one-codimensional submanifold that is generic in 
C". Strong pseudoconvexity of dO. entails that CR orbits of are necessarily 
of codimension ^ 1 in M^. Remind that Theorem 4.10 says that a compact 
subset K of is removable provided it does not contain any CR orbit of M^. 
Conversely, in the case where has no exceptional CR orbit, if K contains 
a (then necessarily compact and maximally complex) CR orbit N of M^, then 
K is not removable, since N is tillable by some {n — 1) -dimensional complex 
subvariety S C 17 with (9S = A^. Thus, while comparing the two Theorems 4.10 
and 5.2, the true question is whether the assumption that C 90 = M be 
diffeomorphic to the real (2n — 2) -dimensional real ball ij2"-2 ^ 1^2^-2 pj-gyents 
the existence of compact (2n — 3)-dimensional CR orbits of M^. This would yield 
a neat statement, valid in arbitrary complex dimension. 

For instance, let := 9B„ n i7 be the intersection of the sphere 0B„ ~ g'in-i 
with a complex linear hyperplane H C C"". With such a simple N homeomor- 
phic to a (2n — 3) -dimensional sphere, one may verify that every C°° subman- 
ifold C 50 containing N which is diffeomorphic to ij2"-2 jjjygf contain 
at least one nongeneric point. Nevertheless, admitting that N has slightly more 
complicated topology, the expected generalization of Theorem 5.2 appears to fail, 
according to a discovery of Joricke-Shcherbina. This confirms the strong differ- 
ences between CR dimension m = 1 and CR dimension m ^ 2. 

Theorem 5.6. ( IIJS2000II ) For e £ R with < e < 1 dose to 1, consider the 
intersection 

Ne := {ziZ2Z3 = e}n VsdMs 

of the complex cubic {Z1Z2Z3 = e} with the sphere -v/SSBs = {l^ip + \z2\'^ + 
|^;3p = 3}. Then A^g is a maximally complex cycle diffeomorphic to x x 
bounding the (nonempty) complex surface := {Z1Z2Z3 = e} Ci B3. Further- 
more, there exists a suitably constructed C°° generic one-codimensional subman- 
ifold C 5B3 diffeomorphic to the real (2n — 2) -dimensional unit ball ij2n-2 
containing N,.. Finally, since A'g bounds S^, every compact subset K C 
containing Ng, is nonremovable. 
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5.7. Elliptic isolated complex tangencies and Bishop discs. Coming back to 
complex dimension n = 2, we survey known properties of isolated CR singu- 
larities of surfaces. So, let 5 be a two-dimensional surface S in of class at 
least C^. At a point p E 5, the complex tangent plane TpS is either totally (and 
in fact maximally) real, viz. TpS H JTpS = {0} or it is a complex line, viz. 
TpS = JTpS = TpS. An appropriate application of the jet transversality the- 
orem shows that after an arbitrarily small perturbation, the number of complex 
tangencies of S is locally finite. 

If S has an isolated complex tangency at one of its points p. Bishop ( IIBil965l ) 
showed that there exist local coordinates {z, w) centered at p in which S may be 
represented by tt; = zz+A(2;^+z^)+o(|zp), where the real parameter A € [0, oo] 
is a biholomorphic invariant of S. The point p is said to be elliptic if A G [0, ^), 
parabolic if A = ^ and hyperbolic if A G oo]. The case A = oo should be 
understood as the surface w = z'^ + z"^ + o(|zp). The shape of the projection of 
such a surface onto the real hyperplane {Im t/; = 0} ~ M'^ is essentially ellipsoid- 
like for < A < 1/2 and essentially saddle-like for A > 1/2. 

In the seminal article ||Bil965l . Bishop introduced this terminology and showed 
that at an elliptic point, S has a nontrivial polynomial hull S, foliated by a con- 
tinuous one-parameter family of analytic discs attached to M. The geometric 
structure of this family has been explored further by Kenig and Webster. 

Theorem 5.8. ( IIKW1982I IBG1983I IKW19841 IHul998l ) Let S C be a 

(k ^ 7) surface having an elliptic complex tangency at one of its points p. Then 
there exists a C^'^~'^^^^ one-parameter family of disjoint regularly embdedded an- 
alytic discs attached to S and converging to p. If S is C^, then S is C^'^. Fur- 
thermore, every small analytic disc attached to M near p is a reparametrization 
of one of the discs of the family. 

For K = oo, the union of these discs form a hypersurface S with boundary 
dS = S in a neighborhood of p. Furthermore, S is the local hull of holomorphy 
of S at p. 

In the case where S is real analytic, local normal forms may be found that 
provide a classification up to biholomorphic changes of coordinates. 

Theorem 5.9. Let S : w = zz + X{z^ + z^) + Od^p) be a local real analytic 

surface in passing through the origin and having an elliptic complex tangency 
there. 

• (' IIMW1983i ) For every A satisfying < A < 1/2, either S is locally 
biholomorphic to the quadric w = zz -\- \{z'^ + z^) or there exists an 
integer s G N, s ^ 1, such that S is locally biholomorphic to w = 
zz -\-[\ + 5u^] {z^ + z^), where u = 'Kew and 6 = ±1. 
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• ( IIMol985ll ) For A = 0, either S is locally biholomorphic to w = zz + 

+ + 0{\z\^~^^) for some integer s ^ 3 or S is locally biholomorphic 
to w = zz. 

• ( ||HuKrl995ll ) For A = and s < oo, the surface S is locally biholomor- 
phic to the surface w = zz + z^ + z^ -[-Y^-j^i^^^ aj^ z^z^, with ajk = o-kj- 

In all cases, after the straightening, S is contained in the real hyperplane 
{Im w = 0}. 

In the third case A = 0, s < oo, it is still unknown how many biholomorphic 
invariants S can have. 

5.10. Hyperbolic isolated complex tangencies. The existence of small Bishop 
discs attached to S and growing at an elliptic complex tangency impedes local 
polynomial convexity. At the opposite, if 5 is hyperbolic. Bishop's construction 
fails, discs ai^e inexistent, and in fact 5 is locally polynomially convex. 

Theorem 5.11. ( IIFS1991II ) Let S C C"^ be a C'^ surface represented by w = 
zz + X{z'^ + z^) + r{z, z), with a remainder r = o{\z\'^). If X > 1/2, viz.. if S 
is hyperbolic at the origin, then for every pi > sufficiently small, S H (pi]B2) is 
polynomially convex. 

The Oka- Weil approximation theorem then assures that continuous functions 
in 5 n (P1B2) are uniformly approximable by polynomials. 

A local Bishop surface S is called quadratic if it is locally biholomorphic to 
the quadric w = zz + A(z^ + z^). An isolated complex point p of 5 is called 
holomorphically Hat if there exist local coordinates centered at p in which 5 is 
locally contained in {Imu; = 0}. Unlike elliptic points of surfaces that are 
always flat, hyperbolic complex points of surfaces may fail to be flat. 

Example 5.12. ( IIMW1983II ) The algebraic hyperbohc surface (A > 1/2) 

w = zz-\- X{z'^ + f) + Xz^z 
cannot be biholomorphically transformed into a real hyperplane. 

Theorem 5.11 establishes local polynomial pseudoconvexity of surfaces at hy- 
perbolic complex tangencies. By patching together local plurisubharmonic defin- 
ing functions, one may easily construct a Stein neighborhood basis of every sur- 
face having only finitely many hyperbolic complex tangencies. Unfortunately, in 
this way one does not control well the topology of such neighborhoods. A finer 
result answering a question of Forstneric is as follows. 

Theorem 5.13. ( IIS12004II ) Let S be a compact real C°° surface embedded in a 
complex surface X having only finitely many complex points that are all hyper- 
bolic and holomorphically fiat. Then S possesses a basis of open neighborhoods 
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. Vs = Us'<s H'; 

• each Ve has a C°° strongly pseudoconvex boundary dVs', 

• for every e with < e < ei, the surface S is a strong deformation retract 

ofVe. 

It is expected that the same statement remains true without the flatness assump- 
tion. 

5.14. Real surfaces in strongly pseudoconvex boundaries. Coming back to re- 
movable singularities, let dO, d be a strongly pseudoconvex boundary 
and let S C be a compact surface, with or without boundary. It will be no 
restriction to assume that S is connected. Suppose that S has a finite (possibly 
null) number of complex tangencies. These points then constitute the only sin- 
gular points of the characteristic foliation of S. At an elliptic (resp. hyperbolic) 
complex tangency, the phase diagram simply looks like a focus (resp. saddle). 

Theorem 5.15. ( MFS 19911 ) Let M be a two-dimensional Stein manifold, let 50 d 
A4 be a strongly pseudoconvex boundary and let D be aC^ one-codimensional 
submanifold that is diffeomorphic to the unit open 2-disc ofM? and is maximally 
complex, except at a finite number of hyperbolic complex tangencies. Then every 
compact subset K of D is CR- and W -removable. 

Indirectly, the characterizing Theorem 3.7 of Stout yields the following. 

Corollary 5.16. Every compact subset K C D C d^l is 0{0,) -convex. In particu- 
lar, such a K is polynomially convex if M = and ifQ is Runge or polynomially 
convex, e.g. if^l = B2. 

The (short) proof mainly relies upon the (very recent in 1991 and since then fa- 
mous) works ||BK1991i and ||Krl991|| by Bedford-Klingenberg and by Kruzhilin 
about the hulls of two-dimensional spheres contained in such strictly pseudo- 
convex boundaries C M, which may be filled by Levi-flat three-dimensional 
spheres after an arbitrarily small perturbation. 

Theorem 5.17. ( IIBK1991[lKrl991ll ') Let n C"^ be a strongly pseudoconvex 
domain and let S C 517 be a two-dimensional sphere of class embdedded into 
do, that is totally real outside a finite subset consisting ofk hyperbolic and k -\- 2 
elliptic points. Then there exist: 

1) a smooth domain B C M^(2;i, X2, X3) with boundary dB diffeomorphic 
to S such that x-^ : B ^ M is a Morse function on dB having k + 2 
extreme points and k saddle points, whose level sets {xs = est.} n B are 
unions of finite numbers of topological discs; and: 
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1) a continuous injective map ^ : B ^ Q sending dB to S, the extreme and 
saddle points of X3 on dB to the elliptic and hyperbolic points of S and 
the connected components of {x^ = est.} Fi B to geometrically smooth 
holomorphic discs. 

The set ^{B) is the envelope of holomorphy of S as well as its 0{Q)-hull, i.e. 
its polynomial hull in case O is polynomially convex. 

In IIDul993L motivated by the problem of understanding polynomial convexity 
in geometric terms, the question of 0(^7) -convexity (instead of removability) of 
compact subsets of arbitrary surfaces S C 80. (not necessarily diffeomorphic to a 
2-disc) is dealt with directly. If K is a compact subset of a totally real surface S C 

dQ, denote by iCgss '■= ^o(n)\-^ essential 0{U)-hull of K. An application 
of Hopf's lemma shows that if K = A{dA) is the boundary of a analytic 
disc A G 0{A) n C^(A) attached to the surface S, necessarily K = Kess is an 
immersed curve that is everywhere transversal to the characteristic foliation of 
S. If S has a hyperbolic complex tangency at one of its points p and if A{1) = p, 
then A{dA) must cross at least one sepai^atrix in every neighborhood of p. When 
i^Toss contains no analytic disc, similar transversality properties hold. 

Theorem 5.18. ( IIDul993ll ) Let K S C dU C"^ be as above, with dQ € 
strongly pseudoconvex and S £ C'^ having finitely many hyperbolic complex tan- 
gencies. In the totally real part of S, the essential 0{Vl)-hull K^ss of K crosses 
every characteristic curve that it meets. If K^ss meets a hyperbolic complex tan- 
gency, then it meets at least two hyperbolic sectors in every neighborhood of p. 

As a consequence ( IIDul993l ). every compact subset K of a two-dimensional 
disc D C dil that has only finitely many hyperbolic complex tangencies is 0{Q,)- 
convex. 

5.19. Totally real discs in nonpseudoconvex boundaries. All the above results 
heavily relied on strong pseudoconvexity, in contrast to the removability theorems 
presented in Section 6, where the adequate statements, based on general CR ex- 
tension theory, are formulated in terms of CR orbits rather than in terms of Levi 
curvature. The first theorem for the non-pseudoconvex situation was established 
by the second author. 

Theorem 5.20. ( IIPo2003ll ) Let M be a C°° globally minimal hypersurface ofC? 
and let D <Z M be a C°° one-codimensional submanifold that is diffeomorphic to 
the unit open 2-disc o/M^ and maximally real at every point. Then every compact 
subset K of D is CR-, L^- and W -removable. 

We would like to point out that, seeking theorems without any assumption 
of pseudoconvexity leads to substantial open problems, because one loses al- 
most all of the strong interweavings between function-theoretic tools and geo- 
metric arguments which are valid in the pseudoconvex realm, for instance: Hopf 
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Lemma, plurisubharmonic exhaustions, envelopes of function spaces, local max- 
imum modulus principle. Stein neighborhood basis, etc. 

We sketch the proof of the theorem. We first claim that M\K is (also) globally 
minimal. Indeed, if there were a lower-dimensional orbit O of M\K, we would 
obtain a lower-dimensional orbit of M by adding all characteristic arcs intersect- 
ing O ( IIPo2003L Lemma 1; IIMP2006aL Lemma 3.5). Then by Theorem 4.12(V), 
continuous CR functions on M\K extend holomorphically to a one-sided neigh- 
borhood V^(Af 

For later appUcation of the continuity principle, similarly as in IIMP2002[ 
IPo2003[ IMP2006aL we deform M\K in V^{M\K), so that the functions are 
holomorphic in some ambient neighborhood U of M\K in C^. 

The first key idea is to construct an embedded 2-sphere containing a neighbor- 
hood of K in D and to apply the filling Theorem 5.17. This will give us a Levi 
flat 3-ball foliated by analytic discs, which by translations, will enable us to fill in 
a one-sided neighborhood of K. 

In the case where M = is a strictly pseudoconvex boundary, the con- 
struction of the 2-sphere is quite direct: we pick an open 2-disc D' having 
boundary dD' ~ 5"^ with K <Z D' <s, D; translating it slightly and smoothly 
within 90, we obtain an almost parallel copy D" C dO.; then we construct the 
2-sphere S' by gluing (inside d^) a thin closed strip ~ [— e, e] x 5"^ to dD' ~ 
and to dD" ~ S^; finally, we perturb the strip part of S' in a generic way to 
assure that S' has only (a finite number of) isolated complex tangencies of elliptic 
or of hyperbolic typq^. Then Theorem 5.17 yields a Levi-flat 3-ball B' C with 
OB' = S'. 

If M is not strongly pseudoconvex, the filling of S' by a Levi-flat ball B' may 
fail, because of a known counter-example IIFM1995I . As a trick, we modify the 
construction. Using the fact that the squared distance function dist {■, D')^ is 
strictly plurisubharmonic in a neighborhood of D (by total reality), for e > 
small, the sublevel sets 

n', := E : dist {q,ly) < e} 

are strongly pseudoconvex neighborhoods of D' intersecting M transversally 
along the 2-spheres d^'^ n M. 



Observe that since D is totally real, the last step can be done without changing S' 
along D'. 
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Furthermore, a given fixed Q'^ can be sligiitly isotoped (translated) to a domain 
Q' still strongly pseudoconvex and having boundary transverse to M so that D' is 
precisely contained in the isotoped 2-sphere dQ' H M. After a very slight generic 
perturbation, we may insure that 5' has only elliptic or hyperbolic complex tan- 
gencies (a pait of 50' has also to be perturbed). In sum: 

Lemma 5.21. ( IIPo2003ll ) There exists a bounded domain Q.' C such that: 

• (90' is C°°, strongly pseudoconvex and diffeomorphic to a 3-sphere; 

• do,' intersects M transversally in a two-sphere S' := dQ' D M; 

• S' has k hyperbolic and k + 2 elliptic points; 

• do' contains the open 2-disc D' D K. 

Then Theorem 5.17 applies in the strongly pseudoconvex boundary 80,', yield- 
ing a Levi-flat 3-sphere B' C O' with dB' = S'. However, the nonpseudocon- 
vexity of M obstructs further insights in the position of B' with respect to M. In 
fact, B' may change sides or even be partly contained in M. 

In the (simpler) case where M = dQ is a strongly pseudoconvex boundary, 
we introduce a foliation of a neighborhood of S' in M by 2-spheres S'^ with 
S'o = S'. By filling them, we get a family of Levi-flat 3-balls B'^ with dB'^ = S'^ 
Denote B'f = Ug A'^ ^ the foliation of B'f by holomorphic discs. For t 7^ 0, each 
A'^ g has boundary dA'^ ,, C S'^ C M\K. Thus, by means of the continuity 
principle, we may extend holomorphic functions in the neighborhood U of M\K 
to a neighborhood of B'f in C", for all small t / 0. A final simple check shows 
that Theorem 2.30 (rmS) applies to remove B'q, and we get holomorphic extension 
to the union UtB'^, a set containing the strongly pseudoconvex open local side of 
Q at every point of K. 

Without pseudoconvexity assumption on M, we can still consider a foliation 
S'^, but now the global geometry of B'^ is no longer clear. If for instance M is 
Levi-flat near K and the S'f are contained in the Levi-flat part, then the B'^ just 
form an increasing family whose union is just a subdomain of M. Therefore it 
seems necessary to deform S' once again in order to gain transversality of B' and 
M. Since the global behavior of B' is hard to control, a further localization is 
advisable. 
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As in HMe 199711 . we consider the set K^r of points q ^ K such that 
0(y{M\K)) does not extend holomorphically to a one-sided neighborhood 
of q. So 0(y{M\K)^ extends holomorphically to a one-sided neighorhood 
V''{K\Kr,r). By deforming M at points of K\Kr,r, we come down to the same 
situation with K replaced with K^^, except that no point of A'nr should be remov- 
able. Assuming K^,- / 0, to conclude by contradiction, it then suffices to remove 
only one point of K^r- 

To begin with, assume that ETnr is contained in finitely many of the disc bound- 
aries 9Aq g which foliate S' = S'q. Then we claim that no OA'q ^ can be contained 
in i^nr- Otherwise, OA'q ^ C K^v C D' C D and the 2-disc enclosed by 9Ao,s 
in S'q inside the totally real 2-disc D' contain no complex tangencies, but the fill- 
ing provided by Theorem 7.17 excludes such a topological possibility. So K^j- is 
properly contained in a finite union of arcs, and hence removable by Theorem 4.9. 

Therefore we may assume that Knr has nonvoid intersection with infinitely 
many of 3Aq ^. Since there is only finitely many complex tangencies, there exists 
a 9Aq with 9Aq n K^j- / not encountering them. The same argument as 
above shows that OA'^ ,,^ <f_ A'nr- Letpo £ "^^o.so ^ -^^J'- 

If Aq and M meet transversally at p'q, holomorphic extension to a one-sided 
neighborhood at p'q proceeds as in the strongly pseudoconvex case, by applying 
the continuity principle with discs A[ ^ C B'^ for t ^ O. 

Assume now that Aq is tangential to M in p'q or equivalently, that 5Aq 
is tangential to the chai^acteristic leaf in p'q. The idea is to change the angle of 
the discs close to A'q and to apply the above argument to the deformed disc 
passing through p'q. Since SA'q <f_ ii'nr> we may deform slightly S" near some 
point (7q G (9 A'q g^^K^^: in the direction normal to B' . More precisely, one deforms 
S" slightly, so that Theorem 5.17 still applies, and then picks up the disc of the 
deformed Levi-flat 3-ball that passes through p'q. In view of known results about 
normal deformations of small discs (Proposition 2.21(V); fTrpl990', IBRT19941 
|Tul994al ). the turning of the angle for large discs ( ||FoT986nG11994il ) may also 
be estabUshed in such a way (see l|Po2003[|Po2004l ). 

There is one final point to be handled carefully. We have to be sure that after 
turning the discs, the deformed disc boundary passing through the point p'q G K^^ 
is not entirely contained in K^^. 
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Choice of Po 



This can be assured by replacing Pq by another special nearby point p'q G 
with a good transversality property as illustrated above. □ 

Theorem 5.20 is not yet the complete generalization of Theorem 5.15 to 
nonpseudoconvex hypersurfaces, since D is assumed to be totally real at every 
point. If D has hyperbolic complex tangencies, it is not clear whether a sphere S' 
together with a strongly pseudoconvex boundary D S' as in the above key 
lemma can be constructed. The recent Theorem 5.13 indicates that this is possible 
if hyperbolic complex tangencies ai^e holomorphically flat, an assumption which 
would be rather ad hoc for the removal of compact sets K C D. 

In fact, assuming generally that M is an arbitrary globally minimal hypersur- 
face, that a given surface S C M has arbitrary topology (not necessarily diffeo- 
morphic to an open 2-disc) and possesses complex tangencies, the reduction to the 
filling Theorem 5.17 seems to be impossible. Indeed, Fornaess-Ma ( IIFM1995I ) 
constructed an unknotted nonfiUable 2-sphere 5 C having only two ellip- 
tic complex tangencies. To the authors' knowledge, the possibility of filling by 
Levi-flat 3-spheres some 2-spheres lying in a nonpseudoconvex hypersurface is a 
delicate open problem. In addition, for the higher codimensional generalization 
of Theorem 1.2, the idea of global filling seems to be iiTclevant at present times, 
because no analog of the filling Theorem 5. 17 is known in dimension n ^ 3. 

5.22. Beyond this survey. In the research article IIMP2006ai placed in direct con- 
tinuation to this survey, we consider surfaces S having arbitrary topology and we 
generalize Theorem 5.20 to arbitrary codimension, localizing the removability 
arguments and using only small analytic discs. 
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